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CHAPTER I. 

DEMaNSTRATlOx^ OF A CATTS PRE -SERVICE PRACTICUM FOR 
TRAINING TEAQERS OF THE MILDLY HANDICAPPED 



Introduction 

This report describes the operation of a model pre-service special education 
teacher preparation practicun conducted at the Center for Innovation in Teaching 
the Handicapped (CITH}, Indiana University, during the 1975-76 school year. Each 
aspect of the training prograni was designed from a competency-based teacher edu- 
cation (CBTE) frame -of reference (Semmel, Semmel, Morrissey^ 1976). For exanple, 
expected trainee competencies and performance objectives were made known in ad- 
vance of assessment; assessment criteria were competency-based and mastery levels 
were specified; trainees were accountable for pupil performance and for reporting 
to parents and classroom teachers:, trainee- tested modular units of instruction 
were employed; trainees received unique Con^juter-Assisted Teacher Training System 
(CATTS) feedback of information on selected aspects of their teaching performance; 
and assessment of trainee performance was continuous throughout the duration of 
the program. Furthermore, setting of the training program in a laboratory class* 
room provided an ideal opportunity to study teacher/pupil behavior through the 
collection of behavioral data under carefully controlled laborator)' conditions. 
The training program design provided for both continuous assessment of trainee 
behavior and for the evaluation of the effectiveness of the training interventions 
developed for this program. 

The goal of the training program was the development of trainee skills in 
teaching reading to mildly handicapped pupils. The ability to structure a reading 
program and effectively teach reading are vital conqpetencies r«jquired of all 
elementary level teachers. Coiroetence in the adaptation of skiiils for teaching 
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the mildly handicapped p-^il to read requires prior Juastery of the basic instruc- 
tional skills. The program was developed to provide trainees with a wide range of 
knowledge and skills related to the developzaent of i reading program for mildly 
handicapped piq)ils, and with specific stills associated with the teaching of word 
recognition strategies* The practicmn was structured so that trainees would have 
a full school year of experience in planning and conducting an individual tutorial 
reading program. 

The Con5)uter-Assisted Teacher Training System (CATTS) (SemmeJ, 1975) was 
employed in all phases of training teachers to develop the interactive skills nec- 
essary for inyrovement of pupil strategies of decoding unknown words. CATTS is 
an automated, computer-based system used for collection of observation system data 
and for real-time feedback of selected data to the trainee while he/she is stiil 
teaching. An extended discussion of CATTS arid a review of research on the feedback 
of observation sy.-^tem data in teacher education may be found in Semmel and Semmel 
(1976). 

Utilizing CATTS technology, trained observers coded all oral reading lessons 
conducted by trainees. A coiT?)uterized data base was thus collected which served 
as th« basis for a related series of studies of trainee behavior under two alter- 
native feedback conditions, and foi* the evaluation of other teacher training inter- 
ventions. CATTS was also employed as the method for assisting trainees to generate 
a specific set of teaching behaviors by means of its capacity for real-time feed- 
back of information. In this project, behavioral data was displayed on a TV monitor 
within eyeview of the trainee while the trainee was engaged in teaching. CATTS 
feedback was «lso made available to the trainees in the form of computer printout 
summaries of observation data for each lesson. 

Skills in responding to pupil misciaes during the oral reading of contimuous 
text were selected as the main focus of trainee interactive skill developmemt . 
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Previous research with inservice teachers of the Euucable .^tentally Retarded CH^R) , 
during reading instruction (Brady, 1976; L>Tich, in preparation), has shown that 
e:q>eriemced teachers do not respond to pi^il misLues in functiionai ways and that 
they employ few, or inconsistent, decision rules in determining how to help a 
pupil. Most teachers responded to all pupil miscues, even those that did not 
differ in raeaning frors the text word. The teacher responses, or prompts, to sis- 
cues tended to be of three types - requesting the pupil to spell the text word; 
sounding a^at the text word for the pi^il; and telling the pupil the text word - 
none of which enco^arage pupil development of effective strategies for decoding 
words. Also, when questioned as to the decision rules used in detemdning how to 
projspt, few teachers mentioned pupil skills in reading or characteristics of the 
word and text as inforraation they considered before responding to the pi5)il. 

As a result of these earlier studies, an instructional module on decision- 
making and pro2Z5)ting pi^il niiscues, entitled Pronpting (Brady, 1975), and a reading 
observation system specific to pupil miscues and teacher strategies of helping 
pi^ils recognize words, the Oral Reading Observation System (OROS), Observers 
Training Manual (Brady, Lynch, and Cohen, 2976), were developed. The self-insxxuc- 
tional Prompting roodule was employed in the present study to guide trainees in 
selecting appropriate prompting behaviors. The OROS was enployed as the basis for 
collection of data on pupil/trainee behaviors during oral reading. OROS alsc 
served as the basis for training tutors to discriminate between various classifi- 
cations of pupil miscues and teacher prompts and for feedback of behavioral dar:ta. 

The general goal of the ' vTTS-DROS teacher preparation program was to deveelop 
a conpetency-based teacher eidii^caticm ];.r3grain in reading for pre-service trrai-Tiee^^ 
in the field of special edujcxation. • The specific objectives of the program wer:^ 

* The program was designed s ' *it ^.nuld meet the criteria of CBTE and Hr 

maximally replicable by orhett • -re-st^ teacher trainers and/or researctl^^ 
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2. To ptxyvide trainees with ^uiowledge, skills, and e^qjerience necessary for 
planning and conducting reading instruction for ndldly handic^jped children. 

2. To train pre-service teac) ^urs in specific prompting techniques. 

3. To test the relative efficiency of two alternative feedback conditions 
(C^TTS and Audio) iii producing desired teacher performance 

4. To i/.cieasc trainee decision-making skills through the use of CaTTS tech- 
nology. 

5. To determine the transferability of the trained skills. 

6. To increase pupil ge^ioial j^chievome-^t levels and to modify pupil strate- 
gies of decoding. 

The Selt^ction of Teacher-Training Objectives of the CATTS-OROS Project 

A CBTE format for the design of the training program was selected because of 
its potential for facilitating program development in which the validity of out- 
comes can be documented (Semmel, Sennnel 5 ^:orrissey, 1976). Thrt'/Ughout : \e 
of the prograir, CBTE irplementat ion criteria (Elam, 1971) were einplc^yec art-ox^ - 
larly in the ) location , operationali nation and publication of traiviring: ob;jec- 
tives,. -and in (Conduct of experimental and quasi -e;q)erimental studress rf tr^e 
effectiveness 2^ /^TTS, training materials in prompting skills and ot^^r interv^=:tr- 
tions in5)i**nnei>:^*^c rring the program. 

h ic ^'^^s.Tj v.icumented, as fully as possible, all the procedures.^ 'trainimg 
materia? air :echnjx iies used in the development and conduct of the program. Copies 
of insttr -ctiic: al materials used by the trainees in the program may be found in zhe 
^pendic^s 'mamy of these materials also have mediated coinponents, and these are 
on file at i;i.:t^ Center for Innovation in Teaching the Handic^ped. The emphasis 
upon documei:: i^!ri:on is to facilitate replication of the program, as we believe that 
the vanidity a training program can best be demonstrated by repeated impleme:n- 
tation in a vatrizety of training environments. 



Selection of Reading as the Focus of Trainee Skill Developiaent 

The ability of a teacher to develop and sustain a successful program of read- 
ing instruction is crucial to the education and habilitation of mildly handicapped 
pupils in special or mains treated settings. A number of studies have shovn that 
educable mentally retarded (E.^^Sl) pupils generally read below the grade level that 
would be predicted from their M.A, (Dunn, 1953; Grolle, 1961; Shotick, 1960). In 
a review of the research on this question, Dunn (1953) found that EMR performance 
was below expectancy in 11 out of 14 studies. Tnere is \iils>o avide?,nce that piq)!:^ 
placement does not change the pattern of underachievenneint in readijig fcmfud in 
studies of EMR pupils in special classes, and that k findings sn- th^ .Name i \>r 
mildly handicapped pupils in a variety of clas5 ;>^^c:*i^Te'^ =^ _ ;.r;2»^j^^ 
resource rcrorai ?>ettings) (Goldstein, Moss 5 Jc-rcan,, 1965). 

'^ivimcss rolationshiip between teacher parformair^ce and r ! dUs' raacdirii 
ccMpetenc -^^s tc yet been established, the dis crepmncies be^xw? EMR pupil i$ 
pffirrormanc^ expectancy cannot be attributed to eiitlier pupil iracceriaJt- 
OT teracneT forniance. However, teacher preparation prograrss a:.-:ord a goo^ Qp- 
pczirturaity " : .he study of these relationships, so that we ma * bnctex undemi^ ^ d 
tifee eftetits f training and teacher performance upon pi^il ooccoaneLS, 

Anotiii^. important reason for focusing on skills of teaching reading is thar 
;>*ov'eral surveys of inservice special education teachers have shown that practicing 
teachers regard reading as the area of instruction where they ne^gd the most assis- 
tance (Lilly § Kelleher, 1971; Meyen 5 Carr, 1970; Windell, 1975j), Needs expressed 
by practitioners often relate to availability of adequate matexia^ls (Lilly § Kelle- 
her, 1971; Meyen § Carr, 1970), as well as better iinpleinent£:tion skills (Meyen § 
Carr, 1970; Windell, 1974). However, there is some evidence of a great disparity 
between implementation techniques employed by teachers and the oibjectives of 
extant child-use materials (e.g., Gallagher, 1970). It may well be that the often- 
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expressed need for nore child-use materials is a manifestation of the teacher's 
inabilii:/ to effectively use available reading materials. A well-trained teacher 
should have the specific interactive skills which conylement the planning and 
evaluative skills necessary for effective reading instruction. 

Interactive skill develorMnent should begin early in the teaicher -rreparation 
program, and the specif:, jnter^racci ve skills associac^^d with the te£:::rung of 
reading to ndldly handicapjisi pus^:^: > is an area off h .ghest priority. 
Selection of Skills in IPromprting iPyx^iA Mis cues duriiig <Qral Readimg 

The ability to teach rean^.ng mildly handi-znpped, slow-les=m:in;5: pupils is 
a composite of many critica^ instxucrional skills. ..rainees neec - fciund base of 
knowledge of the psychology a^f^ teachmg reading, ctE Lii dividual difrsr^r^nces, curricu- 
lum, language, and languagt^ ^^velopment. Backgrcirmd .-nowledge ^bouz lieaching read- 
ing should be acquired pril^r -:c. or concurrent with thf^ acquisition of interactive 
skills of teaching. Howev?ir^^ Ttscenz research has Hn-^vn that teachers have both 
inadequate skills for pron-i-ring ora- reading and Lnuc^aiquate understanding of the 
influence of instruction m the chil^d's acquisition of reading proficiency (Lynch 
§ Epstein, 1975). 

Teacher prompting behaviors amd strategies are areas of interactive skill 
that bear directly on how children learn to process words during reading. During 
oral reading in the classroom, the teacher may intervene directly with the pupil, 
in the form of prompting, to influence the way the pupil learns to process written 
text. Such interference may be negative, in that it does not encourage effective 
reading strategies, or it may be positive. Field research (Brady, 1976) has shown 
that most teacher prompting in EMR classes is negative; it encourages inappropriate 
decoding strategies. While comprehension is the ultimate goal of reading, decoding 
strategies can enhance or reduce cocprehension. 

The prompting skills developed in this ^training program were based upon pre- 
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vious research into teacher behavior and decision-siaking during oral reading 
(Lynch S Epstein, 1975; Brady, 1976), and on developoent and field testing of an 
instructional rou:>dule on Pron^pting Oral Reading (Brady, 1975). 

These earlier CITIi research and development efforts wers in "cum based upon 
the theory that learning to read is prirarily a linguistic process and assmaes 
that the prcicesses involved in reading are siniilar to those involved in decoding 
and encoding spoken language (Ryan § Semriel, 1969; Gibson 5 Levin, 1975; Smith § 
Goodman, 1970). The teacher's behavior during reading instruction is seen as 
instrumental in the pupil's perception of reading as another form of language 
communication and is also crucial in shaping the child's set to attend to rele- 
vant features of the text. Thus, how the teacher responds to pupil mis cues in 
oral reading has great influence on how children learn to process written text. 
The CATTS Training Model 

Tne Conyuter-Assisted Teacher Training System (CATTS) was used to iii5)lement 

a model of teacher training (Semmel, 1975) in which the trainee is required to 

generate appropriate teaching behaviors. The model views teaching as: 

"...a performance skill which is best learned by practice in 
training settings, with accurate and rapid feedback of per- 
formance being essential to efficient acquisition of goal 
behaviors. Efficient acquisition of teaching skills is 
dependent upon (a) the specification of target behaviors, 

(b) reliable and valid feedback of performance information 
during or immediately following acquisition trials, and 

(c) access to data from previous training trials." (Semmel, 
1975, p. 249) 

The model stipulates that trainees must be able to discriminate relevant 
teaching behaviors through the mastery of an observation system which defines a 
domain of interest. Tr«anc^s are then able :o derive objectives for desired teach- 
ing behaviors in terms of categories of the observation system. This is the 
"discrimination" phase of the model. In the "generation" phase, trainees teach, 
are observed by trained coders, and observation data is fed back to the trainee 
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for purposes of reinforcenent of desired behaviors and/or evaluation of perforn- 
ance in tenns of perfonaance objectives. The CATTS system, which has the capacity 
to feed back information to rhe trainee in real-time, or to summarize data and 
provide print-out observation system data on one or nore lessons, is used in the 
generation phase. 

In the present study CATTS was used for both real-tinie feedback of infor- 
mation on trainees' use of pronpts, and for provision of suimnary data on each 
lesson. For the purposes of determining the effectiveness of CATTS in aiding 
trainees to acquire desired pronipting behaviors, a study of CATTS feedback com- 
pared with trainee self-evaluation of audiotaped lessons was conducted. 
Research on Teacher Behavior and the Evaluation of Training Interventions 

The conduct of teacher behavior research and program evaluation studies were 
integral to the design of the teacher education project. Four separate studies 
of teacher behavior were conducted, each addressing a different facet of teacher 
training or behavior. In addition, performance and attitudinal outcomes of pupils' 
participation in the tutorial program were reported. The empirical studies con- 
ducted in conjunction with the CATTS-OROS demonstration progiram are summarized 
as follows: 

The Effects of the Pron^ting Module on Teacher Behavior . A study conducted 
during the first semester of the program examined the effectiveness of an instruc- 
tional module on trainee use of prompts and trainee decision rules for prompting. 
Use of a criterion-referenced instructional package was in keeping with the CBTE 
orientation toward standardization of training treatments through the use of 
trainee-tested instructional modules (cf. Thiagarajan, Semwel 5 Semmel, 1974). 
It was predicted that trainees who completed the prompting module would demonstrate 
changes in their prompting behaviors in the directions specified in the module. 

The Effects of CATTS and Audio Tape Feedback on Teacher Behavior . In accord 

ERIC 
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with the CATVS teacher training Siodel (Sermel, 1575), trainees coispleted a dic- 
crimLnation training sequence designed to enable them to identify relevant pro3i?)t- 
ing behaviors. Trainees also cozpleted instructional nodules on the Oral Reading 
Observation Systec (O^OS) whose categories were related to the Pro:iq>ting Module 
which the trainees had comleted the previous seinester. After a period of dis- 
crimination training, the generation phase of the training progran began. Trainees 
were aided in their efforts to generate 'appropriate pronyting behaviors through 
CATTS or audio tape feedback of their pron5}ting behavior. A study was conducted 
which compared the effectiveness of the two types of feedback in modifying the 
pron5)ting behaviors of trainees^ and the relative effectiveness of each mode of 
feedback when compared with trainee procpting during a baseline (no feedback) 
period of teaching. 

The Effects of Training on Teacher Decision-making . Interest in trainee 
decision-making was an outcome of the recognition that trainees' ability to gener- 
ate desired teaching behaviors is insufficient for effective teaching unless tnose 
behaviors are appropriately applied in varied contexts. That is, the behavior 
must be guided by an underlying rationale which forms the basis for the trainees' 
selection of particular behaviors from a set of known alternatives. Trainee deci- 
sion-making in the present project was inferred from trainee reasons for pronpting 
which they gave aftar listening to an audio tape replay of a^esson they had con- 
ducted. Trainee responses to the "stimulated recall** interview were ased to deter- 
mine what information was considered by trainees in making a decision to pronpt 
in a given manner. Also measured was the relative amount of conscious decision- 
making that took place prior to generating a prompt. Observation data was analyzed 
for behavioral corroboration of decision-making data obtained from the stimulated 
recall interview. 

Piq;)il Outcomes . Changes in pupils* reading achievement from the time of entry 



into the program to the end of the project ^ some 34 lessons later, were measured 
through an individual standardized reading test. Also studied on a prc-post basis 
were the pupils' attitudes toward reading and the pupils' reports of how they 
approached the decoding of unknown words during oral reading of connected discourse. 
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Organization of the Practicum 
The major features of the training program are shown in Figure 1. While 
this organizational overview shows all the important aspects of the program, it 
does not indicate the relatively different amount of effort, detail, and time 
expended on each aspect. For example, while trainee and pupil selection was a 
one-time procedure, coder training extended over several weeks, with testing and 
retraining of coders continuous over the entire duration of the project. 
The Laboratory Classroom 

The central physical setting of the project was the laboratory classroom, 
upon which each of the other program elements impinged to some extent. The class- 
room was approximately 30 feet by 20 feet and was equipped with a one-way vision 
window. The one-way window covered the entire width of one wall, and thus per- 
mitted observation of the entire classroom. For the purpose of the study, two 
portable folding divider screens were placed against the extreme left and right 
sides of the one-way observation windows, to create two small isolated areas with- 
in the classroom which were used for oral reading and the collection of oral 
reading observation data. The reduction of noise and other common classroom dis- 
tractions in the booths, created by placement of the screens, provided a rela- 
tively homogeneous, controlled environment in which oral reading lessons were 
conducted and observatior^ data was collected. The booths also functioned as train- 
ing stations. During the second semester, video monitors, on which trainees 
received real-time feedback about his/her prompting behavior, were placed in the 
booths. Figure 2 is an artist's rendering of the oral reading booth as viewed by 
the coder in the observation room. 

' The classroom was large enough to accommodate up to six trainees and six 
pupils simultaneously. The number of trainee and pupil pairs assumed a one-to-one 
trainee-pupil tutorial relationship, the same setting could accommodate small 
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Figure 2. The oral reading booth as viewed from the observation coding room. 
Window provides one-way viewing. I 
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group instruction as well, (The number of trairi^es and pupils that could be ac- 
coiranodated in the lab at any one time depends mainly upon cost factors and- other 



The classroom was run on an informal open plan, with sections of the room 
devoted to different activities that took place during the bi-weekly, hour-long tu- 
torial session. Included in the physical layout of the carrpeted room was a reading 
corner for recreational reading, quiet games, and other • 'vidual informal activ- 
ities. The ''quiet corner** had large floor pillows whicl . jnu /ided an informal and 
comfortable physical setting. The room was also equipped f r-; movable tables and 
chairs which were frequently and easily rearranged to sui ;dividual needs. Other 
equipment more typical of classrooms included blackboards^ supervisor's desk, sta- 
tionary study carrels, file cabinets for records and instructional materials, and 
bookcases. Figure 3 shows the major elements of the physical arrangement of the 
lab class which contained controlled environment areas within an open class 
arrangement. 
Trainee Selection 

There were twenty pre-service, special education trainees in the program, 
each responsible for conducting two semesters of pupil tutoring. The trainees 
were in their junior year and had been admitted to the special education program 
during the previous year. Each trainee was screened into the program following cri- 
teria established by the Indiana University Department of Special Education. The ' 
department admits only 40 students per year, and the academic and background re- 
quirements are quite stringent. Assignment to the CATTS-OROS practicum was based 
primarily upon whether the trainee was free to tutor during the afternoon hours. 
A parallel practicum was offered^ in the morning hours CSemwel § Sitko, 1976). 
< Thus, all junior-year special education trainees participated in one or another 
CATTS practicum. All trainees were concurrently enrolled . in courses on language 



resources available in the program.) 
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Figure 3, Layout of laboratory classroom, 



and reading, reading methods, music and art methods and methods of teaching the 
mildly handicapped. 
Pupil Selection 

Early in the school year announcements were sent to the principals of 10 
elementarj' and one parochial school in Monroe County, Indiana^, concerning the after 
school reading tutoring program. Tl\e schools contacted were those in closest geo- 
graphical proximity to the CITIl Teacher Education Laboratory. Members of the 
Monroe County Community Schools administration were also contacted for approval. 
Assurances of cooperation were received from the Superintendent of Schools, the 
Director of Special Education and the Coordinator of Reading Services, Letters 
describing tiie program were in turn distributed to the teachers by the school prin- 
cipal. The letter described which children were eligible for the tutoring service, 
the time, place, and nature of the program, tutors, and other pertinent informa-r 
tion. Teachers then returned referral forms to CITIl, through the principal. 
Letters were then sent to parents of the childresn referred, informing them of the 
availability of the program. There were several other sources of referral, includ- 
ing an announcement in the local newspaper. The need for tutorial services by 
children whose parents had responded to the newspaper story was then verified by 
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the child's classroom teacher. Another source X)f referral was direct communication 
with the parents of xhildren who had attended a remedial program for pupils for 
specific learning disabilities that had been conducted at CITH the previous semes- 
ter. Only those children whose learning disability was in the area of reading 
were accepted into the present program. \ 

Copies of letters sent to parents, teachers, principals, and administrators 
may be found in the Appendix. 
Eligibility for Tutoring 

Criteria for admission to the tutorial program were as follows: second- and 



third-grade pupils reading at least one year below grade level; 4th-, Sth-, and 
6th-grade pupils at least two year^ behind grade level in readiag, 3otr reguiacr 
and special class pupii^ wer? 4:c:^jrted. Pupils were referred by teachers as - 
ing difficulty in oral idi ng^ woi d recognition and word analysis Skills, 

Initially 20 pupili adiftitlcecl to the program, with six pupils on a m^:^^ - 

ing list. 

First Semester Trainee I' t^t^^ ration: M ethods and Materials 

Trainees spent the fi:Tst thrr^sr:: weeks of the first semester following >i coxvr^« 
of study designed to provide their^ with requisite skills and knowledge involv^ii i 
the teaching of reading, prior to the initiation of the tutoring prograin. /^J]! 
trainees also completed a serien of i?^diated instructional modules, atterr .>.c' 
tures and con^Jleted exercises on fr-arrious aspects of reading and reading di-^S)5ii>, 
The topical sequence of trainee pr^^-tutoring preparation was as follows: 

1. Completion of module: A Decision-Making Model for Teaching the Hamj^ea^ag . 
(Gillespie, 1975). This module is part of the "Tips for Teachers" (Serasnel h Tliiia- 
garajan,. 1975) seriis and was designed as a guide for planning insr- .; n lie 
model attempts to show 'tc:achers ho^i* to go beyond the use of stay^u. dized test::^ and 
use other sources of information about specific strengths and weaknesses of indi- 
vidual children. A diagnostic/prescriptive approach is described, aimed at assist- 
ing teachers to become systematic in collection, evaluation and use of pupil 
assessment data. 

2. Completion of module: Iriformal Reading Inventory (Windell, 1974). This 
module is also part of the "Tips for Teachers" (Semmel 5 Thiagarajan, 1975) series. 
The objective of this mediated instructional package is to provicle the trainee with 
skills and knowledge necessary to construct, administer and interpret an Informal 
Reading Inventory. 

3. Lecture series: All trainees were required to attend a series of lectures 
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on SBirihods of te^adji^ng reading, diagnostic testing, identification of reading 
di^sabilitie^s anc, lesson planning. Trainees were also required to complete exer- 
cises on t'- . xioiministration and scoring of both standardized and infoirmal read- 
ing test. to submit model lesson plans. Topics covered in tlie :iectures given 
by one s:r tr^^ investigators included: overview of diagnostic testing concepts, ten 
termi nolj.v,; , identification of reading disabilities, and discussion < f specific 
diagnost : instruments, 

jrocedures for training and tutoring are shown scheraatical 1\' ir Fl.^/ ro 
e( ^ures ind discussion sessions were devoted to lesson plannin.r . cfs:^r- 
eral >^ or i:>uL;ning, the diagnostic/prescriptive approach, teach " . :f - . 
r^coitr - .::\ :ir\d cc?'?*:^r!ehension, appropriate felection and use of ins'* iccaaJ 
materials, b^^sjz,: rer.' ers and related activities and games. Selects rmu^nig 
material tryv ' pils was based upon skill objectives found in Critf ^ ^ a ding 
(Hackett, i:* :j . 

Accountability , T]^ere were several levels of accountability required of 
trainees participating in the prograjn. Each trainee was required to submit les- 
son plans specifying the instructional objectives for oral reading strategy lesiijons 
and other major areas of reading instruction C®-8-* sight word, analytic skills, 
comprehension) needed by the individual pupil. Trainees submitted lesson plans at 
least four days prior to teaching their next two lessons. These were evaluated by 
the classroom supervisor according to a criterion rhecklirt (see Appendix). Train- 
ees resubnnitted thj plans if they were found, to be inadequate. 

Trainees w^ere also required to establish rapj)ort with the pupil, parents and 
teachers. Trainees communicated with both parents aad teachers regarding the 
pupils* motivations, interventions, specific reading difficulty, remediation plans 
and pupil progress. 

Periodic individual conferences were held by classroom supervisors and trainees. 
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in which all aspects of teaching, except for oral reading prompting, were discussed. 
Oral reading prompting was not discussed so that no confounding of experimental 
treatments would occur. Trainees were under continual direct observation by a class- 
room supervisor who circulated about the laboratory classroom every session. 

Trainees were also required to maintain a cumulative file of diagnostic infor- 
mation, lesson plans, and materials usecJ in teaching. These were Kept in a file 
cabinet in the classroom & id used for reference in developing new lesson plans and 
for evaluation of both pupil and tutor. 

Di agnostic tests . A number of standardized ?7id informal diagnostic instru- 
ments were administered to each piq)il at the beginning of the program in October 
and again at the end of the program in April. The Woodcock Reading Mastery Tests 
(Woodcock, 1973) was used to measure pupil entry levels and achievement on five 
aspects of reading: letter identification, word identification, word attack, word 
con^rehension and passage comprehension. The five subtests were individually ad- 
ministered, and two alternate forms were used to offset pro-post practice effects. 

Pupil Perceptions of Reading Interview (Andrews, 1975) was an orally adminis- 
tered, informal diagnostic instrument used to determine pupils' attitudes toward 
reading. The pupils' responses to a series of open-ended questions were used as 
a rough indication of his/her feelings about reading and perceptions of decoding 
strategies. A scoring system was devised for the instrument since there was none 
acconpanying the instrument. 

The Informal Reading Inventory (I.R.I.) is a method for determining the pupil's 
instructional reading level (Windell, 1974); This is the level at which the pupil 
can read from 95 to 98% of the words in a passage correctly and comprehend at 
least 75% of the material. For purposes of this project, materials for I.R.I.'s 
were drawn from graded passages of the New Open Highways series. Conrplete I.R.I. 's 
were developed for levels P (pre-primer) through 5 and duplicated for administration. 

o 
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Each I.R.I, consisted of three parts: the word list, the oral reading passage 
and comprehension questions. The word list was comprised of 20 v/ords randc ly 
chosen from a list of all words appearing in a particular book. Its purpose was 
to determine the level of the oral reading passage to be used for testing. Pas- 
sages of about 100 words were used for levels P through 2, and four comprehension 
questions accompanied each passage. The passages selected for the remaining lev- 
els were about 200 words long, and eight comprehension questions were written for 
each. Approximately half of the comprehension questions were of the factual type, 
and the remaining questions were evaluative or inferential and required the child 
to. make some decision, draw a conclusion or formulate an opinion concerning a 
particular point. 

The scores from the oral reading passage and from the comprehension questions 
were used together to determine the instructional reading level. Children who read 
more -than 99% of a passage without error and comprehend more than 90% of it are 
reading at an independent level. Children who read between 95% and 98% without 
error and comprehend better than 75% of the material are reading at an instructional 
level, Those who read w::.th more than 10% error and less than 75% comprehension are 
at a frustration level. 

Once the instructional level was determined^ each pupil was placed in the 
Basal reader that corresponded to that level. However, for the purpose of the oral 
reading lessons only, children were placed at one level above their instructional 
level in order for sufficient miscues to occur. 

In addition to the test materials. Criterion Reading (Hackett, 1971) was used 
for the ongoing diagnosis and assessment of various specific reading skills, in- 
cluding phonology, structural analysis and comprehensioHe Tutors used a manual 
of hieic rchically ordered objectives ( Criterion Reading Objectives) and accompany- 
ing assessment procedures for determining pupil proficiency in each skill area 
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and appropriate instructional tasks. Tutors were also encouraged to develop their 
own tests or activities designed to evaluate a child's progress and mastery in 
specific skill areas. 

Child use materials . A variety of materials were used with the pupils for 
oral reading and instruction in reading skills. The New Open Highways Reading 
Series (Johnson, 1973) and the Lippincott Basic Reading (McCracken, 1970) were used 
mainly for oral reading purposes. Also available were the Monster Books (Blance 
5 Cook, 1973), Holt Satellite Books , levels 9-12 (Hunt, 1974), and various Dell 
paperback books (see Appendix for complete list). The program also subscribed to 
two monthly children's magazines: Ranger Rick's Nature Magazine sind the National 
Geographic World . In addition to the reading material available in the classroom^ 
there were commercially packaged reading and skill games for the pupil's use. The 
tutors were encouraged to construct their own original games and instructional 
materials for use with their pupils as well. 

To assist the tutors in both preparation and implementation of their lessons, 
several source books were available: Energizers (Thompson, 1973), Reading Activ- 
ities fo r C hild Involvement , 2nd Edition (Spache, 1976), and Center Stuff for 
Nooks, Crannies, and Comers (Forte, 1973). These references contain ideas, in- 
structions, games, and various activities that provide teachers with creative and 
motivating techniques for developing children's reading skills. In addition, a 
booklet of reading activities was compiled to be used jointly with the comprehen- 
sion sections of the Criterion Reading Serie.5 : Reading Activities and Games to 
Accompany Criterion Reading Objectives in Comprehension for Levels 2 and 3 (Brady, 
unpublished paper). Each of the main and process objectives of Levels 2 and 3 of 
the con5)rehension sections were stated, with at legist one corresponding activity 
designed and/or selected to assist in the teaching ov that particular skill. 

Lesson plans . Each tutor was responsible for writing a weekly lesson plan 



describing the activities to be conducted in the two one-hour sessions. Tae tutors 
were provided with labeled lesson plan forms to fill out as well as a checklist 
which specified the items to be included in each section of the plan. Coinpleted 
forms wexe submitted by noon on the Friday prior to the week the lessons were to be 
taught. 

Two successive lessons were prepared in advance, with each lesson divided into 
two parts: oral reading and specific skill. Information required for each of these 
sections included the objectives, the materials, a description of the activity and 
the evaluation procedures. 

The tutors were required to prepare a 15-minure oral reading lesson for each 
session. The level and exact length of the selection varied depending on the indi- 
vidual pupil, and the tutors w«re responsible for providing the pupils with reading 
material at a level at which there would be an error rate of approximately ten 
percent, in order for a sufficient number of miscues to occur. In addition to oral 
reading, the tutors were required to instruct the children in other reading and 
decoding skills. The number and type of activities conducted each day varied, 
depending on the child's capabilities and needs. Criterion Reading was used to 
determine specific skill areas the child was weak in, although the tutors were also 
allowed to write their own behavioral objectives. This provided the basis for 
instruction in the skill areas. All activities that were conducted were related 
to the stated objectives. The descriptions of the activity in Criterion Reading 
are highly specific, and evaluation of the child's progress was always in relation 
to the stated objectives. The purpose of evaluation was to determine whether or 

not the child could perform a certain skill after instruction in a particular area. 

♦ 

After the lesson plans and checklists were submitted they were evaluated on 
the basi^ of completeness, appropriateness and quality. All of the items stated 
on tha checklist had to be present on the plans. The objectives, activities and 
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materials all had to relate appropriately to one anotlier as well as to the child 
involved. A subjective judgment of quality was mad^ by the classroom si^ervisor, 
based on originality and effectiveness of the plan. If the lesson plan did not 
meet all of these criteria satisfactorily, it was returned to the tutor to be 
revised and/or coii5)leted prior to the teaching of the lessons. 
First Semester Practicuro Procedures 

Tutoring of pupils began during the week of October 20, 1975. Each tutor 
met his/her piq)il on a fixed bi-weekly schedule, one hour each session. Trainees 
met their pupils on a Monday- Wednesday or_.Tufisday-jrhursday basis. Also, there 
were no more than seven tutor-pupil pairs 171 the laboratory class at any one hour. 

Trainees worked with their pupil, in accordance with a lesson plan which had 
been submitted and evaluated in advance of the tutorial. A typical one-hour ses- 
sion included a short period of time for informal discussions or other planned 
activity geared toward inqjroving rapport with pupil, about 15 minutes in silent 
reading, comprehension, and/or language development, and approximately 15 minutes 
of oral reading strategy lessons. 

Trainees and pupils moved freely about the classroom, working at whatever 
areas they pleased (often sitting on the carpeted floor). The only exception was 
during oral reading, which was always conducted at the tables and chairs in the 
observation booth. The classroom supervisor moved about the room, observing the 
tutorials, troubleshooting and coordinating oral reading schedules with the coders 
in the observation room. An informal, relaxed atmosphere was maintained during 
the operation of the classroom. 

Oral reading jrompting module . After the first six tutorials were conducted, 
trainees were assigned to an experimental (group I) or control group (group II). 
Assignment to groups was random and stratified according to trainee scores on a 
test of the modules' content (Oral Reading Pretest Score), and the sex, grade and 



reading level of the pupils. Following the sixth tutorial lesson, the experimen- 
tal group completed the Prompting Module in a single, two and one-half hour grotq) 
administration of the mediated instructional package. During this same tine, the 
control group worked through two mediated instructional modules selected from the 
Tips for Teachers Series: Concept Analysis and Instructional Games for Handicapped 
Children , These modules were also group- administered. After teaching their tenth 
lesson (which was four lessons after the experimental group completed the Prompt- 
ing Module) ^ the control group worked through the Pronyting Module while the 
experimental group completed the Tips for Teachers modules. 

'^e Prompting Module was administered at different intervals during the tutor- 
ing program in order to test the effectiveness of the module in changing the 
prompting behavior of trainees. The module administration schedule made possible 
the subsequent comparison of all trainees' prompting behavior during the baseline 
period (first five lessons) with their prompting behavior after completion of the 
module. It also made it possible to compare the proii5)ting behavior of the experi- 
mental group with that of the control group (lessons 7 through 9). The results of 
completing the Prompting Module for each group are found in Chapter III, section 1. 
Second Semester Practicum Procedure 

Figure 5 shows the plan of activities for the second semester training and 
tutoring. 

After a five-week winter recess, trainees met for five bi-weekly groiq) train- 
ing sessions. The main objectives of the training sessions were as follows: 

1. Develop trainee discrimination skills by learning the Oral Reading Obser- 
vation System (OROS) . 

2. Familiarize trainees with CATTS feedback, including interpretation of 
computer printouts, 

3. Use knowledge of OROS and CATTS to graph and interpret the results of 
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CATTS-OROS Training and Practice Sequence, Second Semester (CATTS § Audio Feedback) 
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first seiaester tutorials. 
4. Set individual prompting behavior goals. 

Materials included in these training sessions included Module I, The Coii^)uter- 
Assisted Teacher Training System Trainee Manual and the PROS Training Manual - 
Student Version . Tne student version of the OROS training manual was a modified 
form of the extended version used for the training of coders. Exercises and VTR 
Protocol materials used for coder training were also used with the trainees, but 
the criteria of proficiency were not as stringent as in coder training. The out- 
come of discrimination training is discussed in Chapter III, Section 2. 

Following the five bi-weekly discrimination training sessions, which extended 
over a 2^-week period, trainees resumed tutoring. Except for a few changes, tutors 
worked with the same pupil they had taught during the first semester. 

The first two weeks of tutoring was a baseline period, and trainees taught 
just as they had done during the first semester, that is, with no feedback. During 
the baseline period, trainees also conpleted Trainee Manual II - Developing Teach- 
ing Skills , which described how to interpret a computer printout of prompting 
behavior and how to use feedback from their own pron5)ting behaviors to set new 
goals to inqprove prompting. In addition, trainees graphed and interpreted the 
printout data showing their first semester teaching performance and also developed 
performance objectives. 

CATTS and audio feedback . The CATTS model of teacher training is predicated 
on the notion that trainee skills can best be developed through discriminable 
teacher behaviors, amd through rapid and reliable feedback of relevant teaching be- 
haviors to the trainee. CATTS has been developed to provide both real-time and 
post-teaching feedback of information on observed behaviors. 

In the present training program, the CATTS training model and procedures were 
applied with half the trainees in the practicum. An alternative form of feedback - 
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audiotape- replay or the vvhole lesson - was given to the other half of the trainee 
group. The purpose of providing two forns of feedback to trainees was to test the 
relative effectiveness of CATTS feedback in shaping desired trainee behaviors, con- 
pared with audiotape self-evaluation (i.e., trainees coded their O'^ti behavior). 
This later feedback node is more typically available in training programs - the 
conpaYative effectiveness of each feedback mode is therefore an important question. 
All tutors received the saiae preparation prograir., including discrimination train- 
ing, decision rules for prompting oral reading, miscue interpretation, and perform- 
ance objectives. Only the node of feedback varied for the two groups. Later in 
the second semester, feedback groups were exchanged, so that all trainees in the 
program experienced both feedback modes. 

Feedback groups , Trainees were assigned to two feedback groups during the 
second week of baseline tutoring. Assignment to groups was random and stratified 
according to their pupils' average percentage of 21 (meaning change) miscues ob- 
tained during the first semester. Tims, pupils were rank-ordered according to 
percent of 21 miscues (adjusted for self-corrections) and then the pupil-tutor 
pairs were randomly assigned to CATTS feedback or audio feedback groups. Percent 
of 21 miscues was regarded as a measure of the difficulty that the pupil was hav- 
ing in oral reading. 

After teaching the four baseline lessons, two simultaneous group sessions were 
held for the training of tutors on the use of feedback. Tutors assigned to CATTS 
were shown the real-time feedback display of prompting category frequencies and 
also instructed on the procedures for obtaining and interpreting post-teaching 
CATTS printouts. The tutors assigned to the audiotape feedback group received 
instructions on obtaining a tape of their lesson and on procedures for analyzing 
it for prompting behaviors. 

Procedures for tutoring with feedback . In keeping with the thrust of the 

5. 
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proi^Jting module, all trainees were instmcted to neet the follov.'ing behavioral 
goale: 

1. Pronpt only meaning change (21*) niscues. 

2. Do not prompt any no meaning change (22*) miscues. 

3. Increase use of so-called ''module proii5)ts*' which were as follows: 

33* structural prompt - teacher asks or tells pt^il to identify 
syllables in target word. 

34* attention pronq^t - teacher focuses the child's visual attention 
on word. 

44* pattern prompt - teacher asks pupil for or gives a rhyme or word 
tamily cue to target word. 

45* phonics prompt - teacher asks for or tells a rule concerning a 
letter/ sound relationship in a word. 

52* context promp t - teacher uses information in the sentence or 
story to cue pupil about the word. 

4. Do not continue to prompt same word if pronpts are still unsuccessful 
after two tries. Tell the pupil the word and go on. 

5. Decrease or eliminate all other categories of pronpts. The OROS system 
classifies all possible teacher prompting behaviors; five of these beha- 
viors, referred to as the module prompts (above), are desirable, func- 
tional pron^Jts that the teacher should be able to generate. Other 
possible prompts* that teachers use are regarded as dysfunctional and 
trainees should work to eliminate them from his/her repertoire of proiH)t- 
ing behaviors. 

To aid in mastery of these behavioral goals, trainees received some form of 
feedback on their prompting behaviors during each oral reading lesson. The CATTS 
feedback group of trainees had a TV monitor in the oral reading booth and received 
information in the form of moving bar graphs indicating the relative frequency of 

♦ OROS code numbers. 
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use of each of the five nodule prompts, ''other pror^jts'' and "telling/' After each 
lesson, CATTS feedback tutors also received a printout surjiarv- of their oral read- 
ing behavior (see sanple printout. Appendix), 

The audio feedback group received cassette tape recordings following eacli oral 
reading lesson. To aid the audio feedback tutors in self-evaluation, a tally sheet 
for calculating the frequency of occurrence of ORGS behaviors was provided. Train- 
ees were required to turn these in (along witii a Feedback Lvaluation Sheet) prior 
to teaching their next lesson (see Appendix). 

Both groups of tutors completed the Feedback Evaluation Sheet and were re- 
quired to turn it in prior to teaching their next lesson. The purpose of this was 
to assure that the trainees would focus on the use of prompts, by continuous exam- 
ination of their own proir^ting behavior and its status relative to behavioral goals. 
The CATTS feedback group u^ed the printout suncnary as the basis for completing the 
Feedback Evaluation Sheet. Once feedback was instituted, the evaluation procedure 
was required for every lesson thereafter. 

A group training session was held after the sixth lesson for the purpose of 
reiterating and reinforcing the use of the five module prorap-,s. Written exercises 
and exanples were provided, and trainees were also given cirterion levels for use 
of pronpts in the subsequent lessons. Trainees were told to try to achieve 75% 
use of five module prompts as their main behavioral goal. They were also instruct- 
ed to concentrate on generating 15% (52 's) and "pattern prompts" (44 's) following 
in two-week successive intervals. The fifth module pron^Jt, "attention" (34's), 
was not targeted as a trainee goal, as first semester data had shown that this 
particular teacher behavior did not require any training effort and that teachers 
could generate it with ease. 

At this point in the program (after the seventh lesson), all trainees were 
required to construct and maintain a graph showing their use of five module prompts. 



This, too, was used to heighten trainees' awareness of the behavioral goals and 
of their cwn performance in relation to the stipulated criteria. 

Mode of feedback was switched after the 17th lesson, and trr^inees who had 
received CATTS feedback now received audiot^es and vice versa. In an effort to 
study the interaction of trainee proii5)ting behaviors with pupil differences, train- 
ees exchanged pupils at the 22nd lesson. Ke were interested in determining if 
prompting patterns established with one child transferred to interactions with 
another child, or whether variations in child behavior have greater influence on 
the teachers* pron^tinif patterns. 

Trainee lesson planning and lesson plan evaluation procedures, instituted 
during the first semester, were continued throughout the second semester of tutor- 
ing, as was the practice of conducting periodic, individual supervisory meetings. 
These tutor- siqjervisory conferences covered all aspects of tutoring except oral 
reading prompting behavior. Trainees also wrote pupil progress repiorts at the 
conclusion of the program, and these were sent to the pup:ils' classroom reacher 
and parents. 
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The procedures outlined in this section described the organizational aspects 
of the teacher training progra.-n. Included were descriptions of the physical set- 
ting of the program, criteria for trainee and pupil selection, the course of study 
required of trainees, diagnostic tests and child use materials, the nature of dis- 
crimination training in the area of proinpting pupil iiiiscues in oral reading, the 
CATTS and audiotape feedback provided to assist trainees in generating appropri- 
ate proii5)ting behaviors, and accountability and assessment techniques. 

It should be noted that trainees were assigned to different Experimental 
(E) and Control (C) groups each semester because assignment to groups was based 
on different criteria eacr semester. In the first emester when the effects of 
the Prorrpting Module cn trainee pre opting behavior were studied, assignment to 
E and C groups was random and straijified according to crainee pretest score on a 
test of knowledge of appropriate prn^tTnpting behavior, and with adjusttment for pu- 
pils' sex, reading grade and class level. In tlie second semester, when the major 
focus was on the study of the ef fe nriveness of CATTS feedback and t>ie trainees' 
ability to generate appropriate proirnpts, the assignment to E and C groups was ran- 
dom and stratified according to the rate of pupils* meaning change ('*21'0 miscues 
obtained during the first semester. 

The next section of this report describes the development of and rationale for 
the Oral Reading Observation System (OROS) , the methods used to train observers, 
and the reliability of coders who observed the lessons conducted by trainees in 
the program. In the section that follows the description of OROS, four teacher 
behavior studies are reported. Since all studies were conducted within the con- 
text of the CATfS tutoring program, with the same pupils, trainees and overlapping 
time-lines, there is some redundancy in the description of each study, even though 
each addresses a distinct and separate aspect of teacher behavior or the teacher 
training program. 
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CHAPTER II. 

THE ORAL READING OBSERVATION SYSTEM (CRGS)^ 
Introduction 

The Oral Reading Observation System (OROS) is a research and evaluation tool 
that enables a trained observer to code teacher and child verbal behaviors during 
an oral reading activity. CROS classifies at a detailed level the kinds of ais- 
cues or oral reading errors made by a pupil, the techniques or pronpts the teacher 
uses in helping the pupil decode words, pupil answers to prompts, and teacher feed- 
back and management. OROS was developed at the Center for Innovation in Teaching 
the Handicapped (CITH) by Mary Ella Brady and William W. Lynch as part of the 
Center's project on "Cognitive Demand Skills of Teachers," a research and develop- 
ment program whose overall goal is to find ways to enhance the cognitively oriented, 
interactive skills of teachers of the handicapped. 

A User's Manual has been written to give guidance to potential users of the 
system. Development of the manual and the accoinpanying Observer's Training Manual 
(Brady, Lynch and Cohen, 1975) was partially based on "A Guide for Developers and 
Users of Observation Systems and Manuals'* (Herbert and Attridge, 1975), in which a 
set of criteria for observation systems was detailed. The User's Manual was designed 
to give a detailed rationale for the development of OROS and the specific categories, 
procedures for data analysis, information on the validity and reliability of the 
instrument, and specific suggestions for coder training procedures using the 
Observer's Training Manual . The Observer's Training Manual is a self-instruccional, 
detailed manual that contains definitions and exaii;)les of all categories and exer- 
cises. It has been used in trainiiig coders to high degrees of accuracy. Both of 

^ Parts of this chapter have been adapted from Brady, M.E. 5 Lynch, W.W., Observ- 
ing reading teachers; A critique of systems and the development of an instrument 
specific to teaching word recognition. Paper presented at the American Educatronal 
Research Association Convention, San Francisco, April, 1976. 
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these manuals may be obtained from the Center for Innovation in Teaching the Handi 
capped. 

Rationale for the Development of PROS 

In view of the high degree of iiT^jortance attached to the teaching of reading 
by both the general public and professional educators, and the large financial 
investment in research and development in reading, it is paradoxical that we know 
so little about how teachers behave during reading iiiStruction and what behaviors 
are related to pupil reading achievement. One of the reasons for this situation 
is the generic nature of the observation instruments that have been used to ob- 
serve teacher processes during reading instruction. Instruments that include 
generic teaching skills, such as control, praise, criticism, and enthusiasm, have 
no categories specific td the subject matter of reading. While process variables 
such as these have been found by some investigators to be significantly related 
to student achievement in reading, the fact remains that, for example, an indirect 
well-organized, and enthusiastic teacher may be teaching skills in reading that 
are not related to reading achievement or may be teaching them in dysfunctional 
ways. To ascertain just what is occurring in the teaching of reading requires 
observation systems that are sensitive to the functional aspects of reading in- 
struction. While the authors agree with Herbert and Attridge (1975) that one 
needs good reasons for developing new observation instruments, we could find no 
low-inference category system specific to the behaviors we wished to investigate, 
namely, teacher-pupil verbal interactions during word recognition in oral reading. 

Research in the methodology of teaching reading has, for the most part, re- 
vealed nothing about effective teacher skills in reading because teacher process 
variables were either ignored or measured with poorly designed rating systems. 
The most well-known of these studies were the First Grade studies. The teacher 
experience and efficiency ratings used in these projects were only slightly 



related to pupil success. But two results - that treatment differences did not 
opeiTate in the same fashion across projects, and that project differences persisted 
after controlling for initial reading level - point to the possibility of teacher 
effects . Bond and Dykstra (1967), in a summary report on these projects, suggested 
that future research should focus on teacher and learner characteristics, and that 
"To l.nprove reading instruction, it is necessary to train better teachers of read- 
ing rather than to expect a panacea in the form of materials" (1967, p. 123). 
These studies, and others, have revealed differential implementation by teachers 
of the same instructional materials. While research such as Barr's (1975) and 
Cohen's (1975) have demonstrated that instructional materials do influence pupils' 
reading strategies, the identification of effective approaches to the teaching of 
reading must be derived from three sources of information - teacher behavior, 
instructional materials, and learner characteristics. 

Farr'and Weintraub pointed out in the preface to the 1974 Annual Summary in 
the Reading Research Quarterly (1974) that research in teacher behavior/ character- 
istics in the reading literature has been declining since 1967. However, in the 
literature related to teacher behavior, rese^archers have continued to investigate 
the relationship between reading achievement and teacher behaviors or to sample 
teacher behaviors during reading. Almost none of these studies produce information 
that is translatable into training procedures for teachers of reading because the 
instruments used do not contain reading specific categories. Though there is a wide 
body of literature from which teacher skills in reading can be hypothesized (e.g., 
Gibson and Levin, 1975; Davis, 1968; and Singer and Ruddell, 1970), researchers 
in teacher behavior and reading have not utilized this literature. 

Studies that have looked at reading classroom behavior with generic instru- 
ments such as Flanders Interaction Analysis (Frizzi, 1972) or related systems (Sotr, 
1966) reveal nothing about effective teacher skills for reading. The variables 



deriving from such systems have no functional relationship to either comprehen- 
sion or word recognition variables which have been shown to be important in reading. 

# 

The fact that indirect control and a warm emotional climate were found to be related 
to pupil growth in vocabulary (Soar, 1966) helps very little when we wish to iden- 
tify teacher skills specific to teaching vocabulary. Dale, O'Rourke, and Bamman 

(1971) suggest techniques to be used in the teaching of vocabulary, an example of 
which is .maximize the transfer of present knowledge of words, roots, prefixes, 
and suffixes*' (p. 4). The teacher behaviors investigated by Soar relate neither 
to this technique nor to any of the others suggested by Dale et al. (1971). Frizzi 

(1972) found that Flanders* revised I/D ratio was significemtly related to the 
perceritage of students mastering the word recognition skill of phoneme -grapheme 
correspondence for the letter £. Reading specific issues, such as whether to teach 

in isolation or within words, were not addressed. 

The series of studies conducted in the Texas Teacher Effectiveness project 
have used reading achievement as one product measure, with the Brophy-Good Dyadic 
Interaction System (1969) being utilized to collect observational data. The vast 
majority of categories in this system are classroom control variables. One read- 
ing specific variable derived from this system, a ratio of divergent to convergent 
questions, was found not to be related at all to student leaming gains in reading 
(Brophy, 1975). A recent study by Weinstein (1976) used the Brophy-Good system and 
found no evidence of teacher bias in verbal interaction towards the high-achieving 
readers. However, Weinstein also found that group membership accounted for an 
additional 25% of the variance in achievement after controlling for readiness scores. 
This result suggests that differences in teacher behavior towards the two groups 
were present, but the instrument used was not sensitive to these behaviors. 

Generic instruments classifying the cognitive level of questions are often 
used to observe reading comprehension activities (Guszak, 1967; Bartolome, 1969; 
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Wolf, King, and Huck, 1968). The categories used in the various systems overlap 
and are directly relatable to levels of reading comprehension. Selected results 
are that the greatest proportion of questions asked by teachers are of the literal 
type (Guszak, 1967; Bartolome, 1969) and that, if teachers receive specific train- 
ing in asking critical questions, pupils will perform significantly better on a 
test of critical reading abilities (Wolf et al., 1968). These results suggest 
that one teacher skill in reading is the ability to generate questions for all 
levels of comprehension. Such observation systems, however, though relevant to 
reading comprehension, do not include knowledge of word meanings, the skill that 
Davis (1968) found to have the largest contribution in variance to comprehension. 
Taking into account psychometric research on factors of con5)rehension could lead 
to observation systems for observing teacher questioning behavior that incorporate 
only those kinds of comprehension questions related to identifiable comprehension 
subskills in readers. 

There are observation instruments specifically developed to observe reading 
instruction. One by Quirk, Nalin, and Weinberg, (1973) has four categories speci- 
fic to reading: comprehension, pronunciation and word recognition, language struc- 
ture, and reading silently. From this instrument one can tell how much time is 
spent in an area of reading, but not how the teacher approaches it. Quirk et al. 
(1973) reported that the largest amount of instructional time in reading is spent 
in pronunciation and word recognition (26%), but no information about specific 
teacher behaviors in pronunciation and word recognition can be determined from 
the observation instrument used. A second instrument, the OScAR-R (Observational 
Scale and Rating-Reading) was devised by Medley for use in the CRAFT project (Har- 
. ris § Serwer, 1966) to provide a record of the degree to wljiich teachers imple- 
mented the method variables of the basal treatment assigned to them. However, most 
categories in this system are not reading specific, which may explain the result 
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of no siljnificant correlations between OScAR-R process variables and student reading 
achievement v.ith 30 correlations performed. Chall and Feldman (1966) gathered in- 
formation about teacher behavior in reading using ratings of behavior, as well as 
a questionnaire and interview. Two factors, excellence in teaching and a sound- 
symbol emphasis, were significantly related to reading achievement. Only the 
instruments of Chall and Feldman (1966) seem to warrant further use, hut their 
observation instrument was not a low-inference category system, but a high-inference 
rating system. 

If reading instruction is to be improved, more continuity between the fields 
of reading and teacher behavior must be established. We know that teachers spend 
by far the majority of their reading instructional time on word recognition skills 
(Quirk et al . , 1973) and that word recognition is often taught in oral reading 
situations (Lynch 5 Epstein, 1974). Two studies suggest the effect of teacher 
word recognition behaviors on pupil reading strategies and achievement. Clark 
(1975) used a modification of Quirk's system (1973), and found that more oral 
reading occurred in low than in high-achieving schools. Piestrup (1973), in an 
investigation of teacher styles in responding to dialect speaking first-graders, 
found that teacher responses to such errors affect reading achievement. In this 
study, pupils in classrooms where teachers demanded Standard English pronunciations 
had significantly lower reading achievement than those who accepted the child's 
speech. However, a more detailed categorization of teacher behaviors during word 
recognition in oral reading is needed if we are to relate teaching strategies to 
pupil reading strategies. 

How a pupil approaches reading and the stages of reading he/she goes through 
have been shown to be influenced both by developmental and instructional factors 
(Barr, 1975; Biemiller, 1970; Cohen, 1975; Weber, 1970). However, none of these 
studies actually observed teacher responses to miscues. Better readers, regardless 



of instructional method, progress to a stage of contextual 1/ and graphically con- 
strained miscues, though the stages differed depending on method (BiemiUer, 1970; 
Cohen, 1975). Poorer readers, however, tend not to progress to the stage of con- 
textual ly and graphically constrained miscues. They fail to self-correct when 
context is distorted (Levitt, 1972; Weber, 1970), nave difficulty utilizing graphic 
cues (Barr, 1975), and once graphic cues are learned, tend to misuse graphic infor- 
mation (Weber, 1968). Goodman (1965) concluded that interruptions during oral 
reading were detrimental and argued that the focus during reading must be placed 
on language. Given the difficulties poor readers encounter, however, to allow oral 
reading with no corrections at all seems counter-productive. It is in just this 
*^situation that the teacher's behavior can encourage effective use of . graphic and 
contextual cues in decoding continuous text. 

The results of the above miscue studies and other research in reading suggest 
relationships between te.icher behaviors during word recognition and pupil reading 
strategies. If a teacher denands exact word-for-word reading^ as most do (Brady, 
1976), the pupil will be using only one source of information to identify words - 
letters. When the focus is only on lated words, pupils tend to make more errors 
and are less likely to self-c( .ot because the grammar^nd meaning of the sentence 
or story are not being attended to (Goodman, 1965). Cohen^s^results (1975) suggest 
that if the teacher always tells the pupil to sound out unknown words, as in syn- 
thetic phonics approaches, nonsense word production and sounding out will be fre- 
quent error types. Spelling, as a teacher approach to word recognition, can cause 
pupils to spell unknown words and will have no relationship, or a negative one, 
to achievement in word recognition. Teaching the names of letters making up a list 
of words to be learned doe i shorten the time to learn the list of words (Samuels, 
1970). Encouraging a child to read for meaning, and showing him/her how to use 
grammar and the meaning of what is being read to decode words, could produce more 
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miscues that fit in the context and more self-corrections. A detailed analysis 
of learner characteristics in reading and of how certain instructional materials 
affect reading strategies can suggest what variables to include in observation 
systems used to observe reading. The effectiveness of teacher behaviors specific 
to reading can then be investigated. 
Purpose 

The Oral Reading Observation System (OROS) has been developed in order to 
provide detailed descriptions of pupil reading strategies and teacher responses to 
pupil errors during oral reading situations. Oral reading, when practiced in the 
purposeless, ''Round-Robin" sense, has been, and continues to be, discredited by 
reading professionals (Spache and Spache, 1973). Recent research, however, sug- 
gests that its use in this manner is still prevalent (Lynch ^ Epstein, 1974; Clark, 
1975). An analysis of the kinds of miscues, or errors, a pupil makes while reading 
continuous text orally can reveal the pupil's approach to reading. For example, 
some readers simply omit words they don't know while others will rake substitutions. 
Or, some readers pay too much attention to graphics , cues , or letters, and very 
little to syntax and semantics, or the grammar and meaning of what they're read- 
ing (cf. Barr, 1975; Biemiller, 1070; Cohen, 1975; Weber, 1970 for descriptions 
of pupil reading strategies). For pupils with dysfunctional reading strategies, 
teacher-pupil interaction during an oral reading situation can encourage the pupil 
to, for exajnple, pay more attention to the meaning of what he/she is reading. 

The authors advocate strategy lessons in which the teacher' s responses to 
miscues are based upon a series of decision rules, incorporating diagnostic pupil 
information (i.e., specific reading skills), word and sentence/story characteris- 
tics and miscue characteristics. A self-instructional module called Prompting 
(Brady, 1975) has been developed to train teachers in these procedures. Not all 
children need such oral reading strategy lessons, but the poor readers (educable 



mentally retarded and remedial), who, for example, fail to self-correct an error 
oven wh6n it makes no sense or produces nonsense words because of sounding out 
(Levitt, 1972; Cohen, 1975), can profit from strategy lessons. 

The primary purpose of OROS is to describe teacher-pupil verbal interactions 
during oral reading of continuous text. Subpurposes are to (1) describe the kinds 
of miscues pupils make as they read orally; (2) identify what kinds of miscues 
teachers respond to; and (3) identify the word recognition strategies teachers 
use to help pupils recognize words and the effectiveness of these strategies for 
the reader. OROS can also be used to evaluate the effects of teacher training 
in word recognition strategies on teacher behaviors, such as with the use of the 
Pronyting module (cf. Brady, 1976). It can also be used to research the effect 
of specific teacher responses to miscues on pupil reading behaviors. 
Selection of Categories 

The first stage in developing an observation instrument that would completely 
and accurately record all relevant behaviors during oral reading activities con- 
sisted of gathering approximately 20 hours of audio- and video-tape recordings 
and field notes from about 35 elementary and special education classes in a large 
city school system during normal lessons. Most classes were using a standard basal 
reading series with an emphasis on meaning. Tapes and observation notes were then 
analyzed to identify the common, recurring forms of reading instruction that en- 
tailed teacher-child interaction. Oral reading by individual pupils was ^"^^ n 
virtually every class. In many classes this took the common form of "round-robin" 
oral reading turns within a reading group, with comprehension questions interspersed. 
Oral reading was also dispersed throughout other lesson activities. Whenever oral 
reading occurred, regardless of the form of instruction, a nearly universal inter- 
active pattern was found that consisted of the teacher responding to reading mis- 
cues by individual pupils. The following was the typical sequence: (1) after 
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reading correctly from the text, a child miscued; (2) the teacher responded with 
a proiH)t (a hint or clue); (3) the child responded with a "provisional try" that 
was either correct or not; (4) the toachor then responded with either an evalua- 
tive remark or another prompt. This sequence usually continued until either the 
child correctly identified the word, or the teacher gave up and told the child the 
correct word. 

As a result of the initial analysis of protocols, efforts were then made to 
cateForize systematically all behaviors during oral reading. Concurrently, a sur- 
vey of research and theory on decoding processes in reading was conducted to iden- 
tify types of raiscuos and forms of teacher assistance that could conceivably occur, 
even though they had not turned up in the first group of protocols. For this, we 
drew on the studies of miscues cited previously, as well as on such studies as 
Samuels, Dahl, and Archwamety (1974), the literature cited by Gibson and Levin 
(1975), and behaviors identified ih Minicours^^ 18 (Ward § Skailand, 1973). Ni :e 
general categories (six of these are further subdivided and will be explained sub- 
sequently) were established, as follows: 

Category 1 - Target Pupil: Exact Oral Reading , The pupil who is reading 
aloud reads words continuously from the text exactly as they are printed. 

Category 2 - Target Pupil; Miscues . The pupil who is reading orally deviates 
from what is printed by (1) reading something different, (2) stopping reading 
completely, (3) inserting a word, or (4) omitting a word. 

Category 3 - Teacher; Look Prompts . The teacher's prompt focuses on all or 
part of the word's visual or structural features. 

Category 4 - Teacher: Sound Prompts. The teacher's proii5)t focuses on sounds 
that are represented by different individual or groups of letters in a word. 

Category 5 - Teacher; Meaning Prompts . The teacher's prompt focuses on the 
meaning of a text word or the meaning of the sentence or story in which the 
word appears. 

Category 6 - Target Pupil: Answers to Prompts . The pupil responds to a teach- 
er pron5)t by trying to decode a word or by answering the teacher. 
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Category 7 - Teacher Feedback and Management . The teacher gives positive 
or negative feedback or manages the oral reading lesson. 

Category 8 - Teacher Tells , The teacher tells the pupil what a text word is. 

Category 9 - Other . Teacher and/or pupil verbal interaction is not concerned 
with oral reading instruction* 

The above categorization was created for two reasons: (1) so that conceptually 
similar behaviors would be under one general category for ease of memorization, and 
(2) so that the numbers of the general categories would increase in the temporal 
order in which the behaviors typically occur in the classroom. 
Summary of PROS Categories 

The conplete version of OROS contains 41 categories as shown in Figure 1. 
The reader is directed to the User^s Manual in the Appendix for a detailed descrip- 
tion and definition of each category in the system, A listing of OROS categories 
and brief definition of each follows. 
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Category 1: Target Pupil: lixact Oral Reading 



Category 2 



Target Pupil: Miscues 



21_ 


Meaning Change 


0 


No Response/Don't Know 




No/Low Meaning Change 


^ 1 


Sounding or Naming Letter! 






2 


No/ Low Siini lari ty 






3 


Migh Simi lari ty 








Dialect Based 






Jy 


Insert ion/Oini ss ion 


Category 


3 : Teacher : Look Prompt s 






31 


Letter Namc(s) 


1 


Direct 


32 


Spelling 


2 


,1 ndi rcct 


33 


Structural 






34 


Attention 






Category 4 : Teacher: Sound Prompts 






41 


Isolated Sounds 


1 


Di rect 


42 


Sound Out Word 




Indi rect 


43 


Unnatural Stress 






44 


Pattern 






45_ 


Sounds Within Words/Phonics Rules 






Category 


S : Teacher: ng Pre. 






51 


Word Meaning 


1 


Direct 


52_ 


Context 


2 


Indirect 











Category 6_ : Pupil: Answers to Prompts 

61 Incorrect Answer/Word 

62 Correct Answer 

63 Self-Correction 

64 Exact Word/Meaningful Miscue 

65 Non-target Pupil Prompts/Answers 



Category 7: Teacher: Feedback and Management 



71 
72 
73 
74 



Positive Feedback 
Negative Feedback 
Management 

Turns to Another Pupil ' 



Category 8: Teacher: Telling 



Category 9: Non-Oral Reading/Other 



Figure 1 . 

The Oral Reading Observation System Categories: Full Version 
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Oral Reading Observation System 
Definitions of Categories 



Code 



Category 



Definition 



Exact Oral Reading: 



The pupil reads with no miscues. 



Piqpil Miscue: 



The pupil deviates from the text in some 
manner. 



21 


Meaning-Change Mis cue: 


The miscue changes the meaning of the sen- 
tence. 




Meaning-Change Miscue Subcategories: 


210 


No Response Miscue: 


The pupil does not attempt the word at all. 


211 


Letter/ Syllable Miscue: 


The pupil makes an isolated sound for one or 
more letters of the word. 


212 


No Graphic Similarity/ 
Low Graphic Similarity 
Miscue: 


The pupil substitutes a word that has fewer 
than half the letters the same as letters in 
the text word. 


213 


High Graphic Similarity 
Miscue: 


The pupil substitutes a word that has at 
least half of its letters the same as let- 
ters in text word. 


215 


Insert i on/Orais s i on : 


The pupil omits a word which is in the text 
or inserts a word into the text. 
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No Meaning-Change Miscue: 



The miscue does not substantially change the 
meaning of the sentence. 



No Meaning-Change Miscue Subcategories: 



222 



No Graphic Similarity 



The word the pupil substitutes is very dif- 
ferent than text word (no more than 2 let- 
ters the same) , but the new word does not 
change the meaning of the sentence. 
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High Graphic Similarity: 



Dialect-Based Miscue: 



Insertion/Omission : 



The word that pupil substitutes is very much 
like the text word (3 or more letters the 
same); the substitution does not change the 
meaning of the sentence. 

The pupil's miscue occurs because he is 
translating text grammar or words into his 
own language. 

The pupil omits a word which is in the text 
or inserts a word into the text that does 
not change the meaning of the sentence. 



Teacher Prompts (3, 4, 5) 



Graphic (Visual) Prompts: Teacher prompts on the graphic features (let- 
ter, syllable, structure) of the word. 



Subcategories: 



Letter Name; 



Spelling: 



Structural ; 



Attention: 



Teacher names or asks for letter(s) within 
the word. 

Teacher spells or asks the child to spell ^ 
the word. 

Teacher tells pupil ^ or asks pupil to iden- 
tify structural components of the word (syl- 
lables, inflected ending, type of word) 

Teacher focuses the child's visual attention 
on word, ("Look at it!") 



Phonemic (Sound) Prompts: Teacher pronqpts on the sound features (conso- 
nants, stress patterns^ phonic role) of word. 



Subcategories: 



Isolated Sound: 



Teacher gives or asks pupil to make the 
sound for letter(s) in the text Word. 



42 



Sound Out: 



Teacher sounds out the word letter by letter 
or asks the pupil to do, so. 



43 


Unnatural Stress: 


Teacher gives unnatural stress to the ini- 
tial consonant and then says the rest of the 
word in a natural manner. 


44 


Pattern: 


Teacher asks pupil for or gives piqpil a 
rhyme or word family clue to text word. 


45 


Sounds within Words and 
Phonics Rules: 


Teacher asks for or tells what souiid(3) the 
letters in the word make by saying another 
word that contains the same sound or by 
telling or asking about a phonics rule, ^ 




5 


Word Prompts: 


Teacher uses semantic or syntactic features 
of word or sentence to aid in identification 
of word. 
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Word Meaning: 


Teacher gives or asks piq)il for meaning/ def- 
inition/association of word. 
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Context: 


Teacher uses information in the sentence or 
story to cue pupil about the text word. 



6 


Pupil Response 


61 


Incorrect Answer/ Word: 


Pupil incorrectly answers the teacher ^s 
prompt, or fails to give an answer. 


62 


Correct Answer: 


Pupil responds correctly to prompt but still 
does not get the text word. 


63 


Self -Correct: 


Pupil rereads and corrects own miscue with- 
out any help or prompting. 


64 


Exact Word/No Meaning 
Change: 


Pupil gives exact text word after teacher 
prompt, or responds with a word that does 
not change meaning of the sentence. 


65 


Other Pupil Answers: 


In group instruction, a non-target pi5)il re- 
sponds to teacher prompt. 
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Teacher Feedback 


71 


Positive Feedback/ 
Encouragement: 


Teacher praises the pupil and encourages at- 
tempts to respond. 
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72 Negative Feedback: 



73 



74 



Management : 



Other Pixpil: 



Teacher tells pupil that miscue or answer is 
incorrect. 

Teacher gives piipil general directions about 
reading, e.g., read slowly, start again, 
repeat, use expression, read carefully, etc. 

In group instruction, teacher calls on non- 
target pupil for answer to prompt. 



Teacher Telling: 



Other Categories 



Teacher tells the pupil the text word, using 
natural pronunciation. 



Non-Oral Reading; 



Teacher, pupil (s) are not talking about oral 
reading or word recognition (e.g., change to 
conprehension discussion during oral reading) 



5. 
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Coder Training Procedures and Reliability 
T rainirLg 

During the academic year 1975-1976, coders were trained on ORGS and had 
periodic maintenance checks throughout the year. These coders were used to code 
observational data from several concurrent projects at CITH. This section describes 
the training procedures used and the results of all observer agreement checks. 

Five students, none of whom had any previous experience with observational 
coding, were hired as coders. Two of the coders Kere masters' students in read- 
ing education who had nine hours completed towards their master's degree. The 
other three were undergraduates working toward degrees in fields other than edu- 
cation. One of the masters' students consistently had the highest or second high- 
est agreement to criterion, while the other was usually fourth or fifth. There- 
fore, it does not seem necessary to hire as coders, people who have had experience 
in reading. Our indications were that training was only slightly faster for the 
reading masters' students. 

At the first training session all coders were given a draft copy of the Ob- 
server's Training Manual (Brady, Lynch, and Cohen, 1976). Several changes were 
made in this manual as problems arose with some coding rules during the first semes- 
ter. Thus, the final copy was not printed until April, 1976. All coders were given 
an overview of the full version of OROS, which has 41 categories. The remaining 
meetings, which took a total of approximately 25 hours, were devoted to coding simu- 
lated and live tapes of oral reading lessons. 

. All coder training was done with DITIMA, a conputer system that provided 
instant feedback on the agreement between coders. Each coder was provided with a 
copy of the text the child in the training tape was reading. (This is necessary 
for accurate coding of miscues.) As each coder listened to the verbal behaviors in 
the lesson, he/she would enter the appropriate numerical codcfs sequentially, as 
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each occurred, into a DATANiYTE box which then fed the codes into a computer • If 
all the codes were in. agreeinent, the tape would continue. If there was a disagree- 
ment, DITRfIA stopped the tape, and the codes each observer had entered would appear 
on the screen. The coders could then discuss why they were not in agreement and 
which code was, in fact, the correct one. This consensus code would then be entered 
on the master box and the process continued. Initially, coder errors on DITRNIA 
were due to incorrt^ct labeling of behaviors. As training progressed, a higher 
prcjportion of errors were due tc- one coder dropping a code, such as a 1. The last 
five or six hours of training were not done with DITRNIA in order to give coders 
practice in non-stop coding of a continuous tape. 

Simulated video tapes were developed for the training. (Audio tapes of these 
training tapes, as well as transcripts of each tape, are available for a reproduc- 
tion charge only from CITll.) Tape 1 introduces all codes, with at least two examples 
or each code.. Tape 2 focuses on category 2 codes, i.e., all miscue codes; tape 3, 
category 3; tape 4, category 4; tape 5, category 5; and tape 6, all ORGS codes. 
(Two criterion tapes were also developed, each with at least six instances of each 
ORX)S code.) 

For the first two training sessions, coders studied the introduction to each 
category in the Observer's Training Manual at home and practiced coding tape 1 during 
the sessions. Two to three sessions of about two hours eacii were devoted to each of 
the remaining tapes. Before coming to eacli training session, coders read and worked 
all exercises in the corresponding section of the Observer's Training Manual . (For 
example, section * of the manual on miscue codes 'was coippleted and studied before 
the sessions on coding miscues were held.) As the training progressed, coders . 
practiced coding the new behavior being learned as well as the previously learned 
codes. Because they were very easy to learn, categories 6, 7, 8, and 9 were taught 
simultaneously with the teacher prompt categories. Separate sei..?ions vfere hot 



necessary for these categories. 
Agreement 

Coder agreement was checked periodically thrcughout the year. The first check 
was done immediately at the end of training, on October 14, 1975. Criterion tape 1 
was iised. It was a simulated oral reading lesson of 35 minutes that included at 
least five instances of each of the 41 ORGS codes. All coders had a copy of the 
text being read and coded the entire 35 -minute tape without stopping. (This was 
the longest continuous coding they had done up to this point.) After the tape was 
coded, there wis a 45-minute break in which coders were not able to study the OROS 
Manual or the text just coded. Then the same tape was coded a second time (without 
stopping) in order to get an estimate of intra-coder agreement. Tnis procedure was 
followed any time intra-coder agreement was taken. One of the authors of OROS served 
as a criterion coder for Criterion Tape 1 and all coder agreement checks. The cri- 
terion coder always stopped the tape in order to be as accurate as possible. The 
coefficient computed was Flanders' modification of Scott's procedure, which gives 
a total agreement coefficient across all categories, corrected for chance agreement 
(cf. Frick and Semmel, 1974). This formula is most appropriate when single events 
are totaled per category in an analysis. Most data from OROS was analyzed this way. 
Correcting for chance agreement is important whenever category distribution is quite 
uneven, as most OROS data is. 

Table 1 - Part A reports the criterion and intra-coder agreements for criterion 
tape 1, done Oct. 14, 1975. This analysis, and all subsequent checks, were done only 
on 35 categories >f OROS, due to program limitations. Category 7 (71, 72, 73, and 
74 codes) was dropped since it is only coded when a 7 appears by itself and is, 
thus, infrequent. Codes 65 (Other Pupil Prompts/Answers) and 9 (Other/Non-Oral 
Reading) were also dropped. The mean agreement at time 1 was .76 with the range 
from .72 to .78. Time 2 and intra-coder agreement is slightly higher. 
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Coders then received approximately eight hQurs_ofjZgc^^ ce with live coding 
of actual lessons before the next agreement check. Criterion Tape 2, a simulated 
tape of all 41 OROS categories, each appearing at least 10 times, was administered 
on Nov. 3, 1975. Part B of Table 1 shows the results. The mean agreemeDt at Time 1 
was .84 (an inprovement of .08), with a range of .78 to .88. All coders but one 
improved at Time 2. The Time 2 and intra-coder agreement means are even higher, 
showing better agreement with the criterion at Time 2 as well as very high intra- 
coder agreement. After this check, all coders began to code live oral reading les- 
sons in the practicum, as well as tapes of inservice teacher lessons. 

For the third c;heck, which occurred on December 5, 1975, four tapes were se- 
lected from the oral reading lessons of 20 pre-service teachers. Tape^ were chosen 
that had high frequencies per category, as well as a variety of categories. Each 
tape was 10-15 minutes in length. The criterion codes were decided by a criterion 
coder listening to the tapes separately and identifying the appropriate codes for 
each behavior. This coder stopped the tapes while coding and replayed many seg- 
ments so as to be as accurate as possible. These criterion codes were then entered 
into the computer. The observers, however, coded each separate tape continuously. 

The results from this third check are presented in Part C of Table 1. Only 
Tape 3A was done a second time to obtain intra-coder agreement. Based upon cri- 
terion code data, three categories with 0, 1, or 2 frequencies were dropped, giving 
a total of 32 categories. This was done so that the coefficients would not be low 
due to disagreements on infrequently occurring categories. Most coefficients are 
in the •70's, sufficiently high, given the nature of the data. 

On December 16, 1975, a fourth check was conducted. Three tapes were selectv^d 
from^ctual lessons conducted by 3S inservice teachers. As for the previous live 
tapes, these were chosen for the number and variety of categories exhibited. The 
tapes were between 10 and 20 minutes in length. Any category with a 0 or 1 fre- 
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quency was autoraatically dropped, making the total number of categories 35. Intra- 
coder reliability was done only on Tape 4A. 

The fifth check was conducted February 15, 1976, using the first criterion 
tape. (No coder had seen this tape since October or had an>/^portunity to study 
it.) The coders coded continuously. This data is sunmiari zed^iiuPart E of Table 1. 
All coefficients show that coders were maintaining high agreement with the criterion-. 

For the sixth check, March 12, 1976, three tapes were selected from actual 
oral reading lessons of 20 pre-service teachers. Again, tapes representative of 
ORGS categories were selected. The coders coded each separate tape continuously. 
The reliability was again computed, first by dropping the usual six categories and 
second by dropping any category with a 0 or 1 frequency. Intra-observer coeffi- 
cients of agreement between first and second codings were done only for tape 6A. 
The results are shown in Part F of Table 1. The mean agreement for Tape 6A, Time 
1 is .65, showing a slight loss from the previous check done on similar pre-servicc 
data. 

The seventh and final check was conducted March 12, 1976, using the second 
criterion tape. (Coders had not seen this tape since Nov., 1975.) The observers 
coded the tape continuously. The coding box used by observer three malfunctioned 
and did not register all codes entered durins th-: first coding of the tape. A new 
box was used for the second run of the tape, and the observer obtained a reliabil- 
ity coefficient of .79. The intra-observer score for coder three was also affected 
by the malfunction in Time 1. Maintenance of training over the whole year was 
shown by the. inean reliability coefficient of Time 2 on April, 1976, of .83, and a 
range of .79 to .89. 

As explained in Frick and Semmel (1974), coder agreement is influenced by the 
number of categories in a system as well as the frequency in each category. The 
naturalistic lessons had an uneven distribution of codes and often low frequencies. 
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Coefficients are, therefore, lower than on artificially constructed data. A sam- 
ple of percentage agreement checks done by hand on the categories occurring more 
than eight times in the actual lessons always showed agreement over 80%. Users of 
OROS are cautioned to study agreement coefficient data before making a final deci- 
sioi> on a coder. Achieving high agreements (over .80) across categories that only 
occur 1, 2, or 3 times, for example, is very difficult. 
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Table 1 



Scotts' Coefficients (Flanders' 


Modification) 


for Coder Agreement 


. . Simulation Tape 


1 (10/14/75) 






Coder 


Time 1 


Time 2 


Intra 


1 


.78 


.84 


.83 


2 


.78 


.80 


.86 


3 


.74 


.83 


.82 


4 


.72 


.70 


.77 


5 


.78 


. 80 


.82 




B. Simulation Tape 


2 (11/3/75) 






Coder 


Time 1 


Time 2 


Intra 


1 


.85 


. 89 


.92 


2 


.88 


.91 


.91 


3 


.85 


.86 


.90 


4 


.78 


.82 


.84 


5 


.82 


.76 


.89 



C, Protocol Tapes from Pre~service Lessons (12/5/75) 



Coder 


Time 1 Tape 3A 


Time 2 3A 


Intra Tape 3B 


Tape 3C 


Tape 3D 


1 


.68 


.74 


.88 .70 


.67 


.62 


2 


.73 


.73 


.84 .70 


.74 


.74 


3 


.75 


.73 


.83 .75 


.84 


.73 


4 


.65 


.60 


.81 .60 


.75 


.69 


5 


.64 


.69 


.71 .71 


.77 


.52 




D. Protocol 


Tapes from Inservice Lessons 


(12/16/75) 






Coder 


Time 1 Tape 4A 


Time 2 4A 


Intra 






1 


.53 


.54 


.86 






2 


.78 


.38 


.45 






3 


...Did Not Participate. 


• • 






4 


.41 


.41 


NA 






5 


.64 


.54 


.93 
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(Table 1 - Cont'd) 



E. Simulation Tape 1 (2/13/76) 


Coder Time 1 




Time 2 




Intra 


1 .83 




.82 




.91 


2 .90 




.91 




.93 


3 .84 




.88 




.91 


4 .89 




.87 




.90 


5 .80 




.87 




.87 


F. Protocol Tapes from Pre-Service Lessons (3/12/76) 


Coder Time 1 Tape 6A Time 2 6A 


Intra 


Tape 6B 


Tape 6C 




1 .63 .64 


.85 


.76 


.66 




2 .56 .64 


.78 


.69 


.65 




3 .65 .55 


.80 


.68 


.64 




4 .67 .63 


.87 


.72 


.67. 




5 .68 .58 


.74 


.65 


.67 





G. Simulation Tape 2 (4/9/76) 
Coder Time 1 



1 
2 
3 
4 
5 



.82 

.81 
* 

.83 
.75 



Time 2 

.84 
.84 
.79 
.89 
.80 



Intra 



.87 

.87 
.85 



*Not reported 
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CHAPTER III,. 

RESEARCH ON TEACHER BEHAVIOR AND EVALUATIO:; OF' TRAINING 



Studies of teacher behavior conducted in conjunction with CATTS-OROS teacher 
preparation practicum are presented in this chapter. There are five velated studies 
each written as separate reports covering enroirical investigations of different 
aspects of teacher behavior. The express purpose in treating each study as inde- 
pendent of the other, even though they were conducted within the fraiaework of the 
same teacher training prograia, was to facilitate subsequent publication of the indi- 
vidual studies. It is for this reason that the reader will find some redundancy in 
each of the reports. Information such as subjects, procedures, background of the 
study and training interventions was reiterated in each report, along with the spe- 
cific treatment or ec^irical questions addre^^sed. 

The first study presented concerns the effectiveness of the Proiqpting module 
on changing trainee prompting behaviors, as measured by CATTS-OROS observation data 
on trainee interaction with pupils. The second study examines the effectiveness of 
two methods of feedback - CATTS and Audiotape - on trainee prompting behaviors. 

The next study concerns trainee decision-making, as measured by both stimu- 
lated recall interview and trainee performance data. The fourth study examines the 
transfer of trainee pron5)ting behaviors acquired during the training program^ 
trainee prompting behavior with a pupil other than the one tutored during the prac- 
ticum. The final study presents a descriptive analysis of pupil achievements in 
reading and pupil attitudes obtained over the duration of the practicum. 
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1. Effects of the Prompting Module on Teacher Behavior 
Problen Statecgnt 

The problem investigated was the effectiveness of the Prompting Modale (Brady, 
1975) in changing the repertoire of behaviors used by pre-service teacher trainees 
in responding to pupil miscuss during oral reading instruction. The Fronting mod- 
ule is a criterion -referenced instructional package designed to provide the trainee 
with a set of guidelines for using certain prompts in response to different types 
of pupil oral reading miscues. It outlines the desired types of teacher proir?)ts and 
provides rules for ^propriate usage. There are audio tape and paper-and-pencil 
exercises for identification of pupil miscues and appropriate teacher proir?)ts. A 
decision-model is included in the module, to guide trainees in their application of 
the various available pron5)ts. It was predicted that trainees who successfully 
completed the prompting module would demonstrate their knowledge of the decision 
rules for prompting by changes in their prompting behavior. The specific questions 
studied in the assessment of the effects of the prompting module were as follows: 
(1) Will trainee behaviors, both cognitive and performance, change significantly 
over time in predicted directions after completing the module? (2) Will the per- 
formance behaviors of those trainees who receive the module prior to trial 2 differ 
significantly from those trainees who receive the module prior to trial 3? 

There were two independent variables in the study: trials (1, 2, and 3) and 
groups (experimental and control). Trial one was made up of the first six tutorial 
reading lessons and constituted the baseline observation period for all trainees. 
Experimental (E) group trainees received the module after the last baseline lesson. 
Trial two consisted of the four lessons (lessons 7, 8, 9 arid 10) which followed the 
E groups' con?)letion of the module. After the last lesson in trial 2 (lesson 10), 
the control group trainees completed the module. The two remaining lessons in the 
semester which followed the control group's completion of the module were trial 

6. ■ ' 



three (lessons 11 and 12). 

The dependent measures were: (1) total raw score on the Oral Reading Scale, a 
test of cognitive knowledge of prompting techniques, (2). percent meaning change mis- 
cues pronpted, (3) percent no meaning change miscues prompted, (4) the percent of 
structural, attention, pattern, phonics, context, and other prompts used, (5) the 
total percent of the five module prompts used, (6) the success rates of the struc- 
tural, attention, pattern, phonics, and context prompts, (7) the total success rate 
of the five module prompts, (8) the total success rate for all pronpts used, and 
(9) the length^of prompt sequences. The predicted directions of behavior change 
were to increase dependent variables 1, 2, 4, 5, 6, 7, and 8 and to decrease^ depen- 
dent variables 3 and 9, and a variable measuring the percent of all non-module 
pronpts. 
Design 

The design used to test for trainee behavior change was a repeated measures 
design, as shown below: 





Tl 


T2 


T3 


(Exp.) Gj 


r - ^ 

H - ho 


h - ho 


Rj - RjQ 


(Cont.) G2 


hi - R20 


hi - R^o 


Rjl - R20 



Since trainees were only tested twice with the Oral Reading Scale, the design for* 
that dependent measure only was a 2 (group) by 2 (pre-post module) repeated measures 
design. In the analysis, subgroups of variables were tested multivariately and/or 
univariately, each subgroup being tested separately. The procedures ushd will be 
explained in greater detail in the results section. 
Procedures 

Subjects . The subjects were 20 special education pre-service teachers who 
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were participating in a practicum focusing on teaching reading to the mildly handi- 
capped. All were in their junior year at Indiana University. Subjects were divided 
into two groiq)s by ranking their scores on the Oral Reading Scale pr^^test from high- 
est to lowest and randomly assigning every other student to one group. (Some ad- 
justments were made on this assignment procedure so that the pupils the trainees 
were instructing could be matched on reading level, sex,, and degree of retardation 
in reading.) ^ 

For each trainee, the practicum ran for seven weeks of the first semester of 
the 1975/76 school year, from October 13 to December 5, as follows:^ 

Lesson Oct, 20 Dec, 5 

Number I 



1 


2 


3 


4 


5 


6 1 


7 


8 


9 


10 1 


11 


12 





o ^ 
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3 
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rt H' 
rt 

(D O 

• 

o 
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c 

o 
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o 

Hi 

o 

rt 
C 
rt 
O 
»i 

•i • :3 

O OQ 
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OP 

< 
o 

09 

rt 
H* 
O 



n I 
o 

I 



Each trainee tutored two hours a week, one hour each day, in all areas of reading, 
focusing primarily on oral reading, comprehension, and specific skill dc/elopment in 
word recognition and comprehension. Approximately 15 minutes of each tutoring ses- 
sion was devoted to oral reading, using the appropriate level, as determined by 
informal reading inventories, of the New Open Highways Series for all pupils able 

^ The first week was devoted to diagnostic testing, so no oral reading lessons 
were conducted. 
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to read in a lev6? .>f the series. Five pisiils initially wors unablo to read ir. 
this series and read language experience stories and readiness books. All five 
pupils were placed in the New Open Highways series by the end of the semester. 
Therefore instructional material was controlled to some extent. This is impor- 
tant since the nature of miscues made by readers is influenced by material type 
(Barr, 1975; Cohm^ 1975). Readability level of the materials did vary, however, 
due to the range of pupil reading levels. All lessons in oral reading were audio- 
taped. All pupils read materials approximately one grade level above their instruc- 
tional level in order that a sufficient number of miscues that needed prompting would 
occur. 

All pupils were drawn from regular and special classes in the public schools 
in Monroe County, Indiana. Criteria for admission to the tutoring program were as 
follows: second- and third-grade pupils reading at least one year below grade level 
and 4th-, 5th-, and 6th-grade pupils, at least two years behind. Priority was 
given to pupils having difficulty in word recognition, word analysis skills, and 
in using functional decoding strategies during oral reading of continuous text. 
Table 1 shows entry level pupil characteris-tics for all pupils individually and by 
groups, including actual grade placement, number of times failed, and reading grade 
placement as determined by informal reading inventories and the Woodcock Reading 
Mastery Tests (Woodcock, 1973). 

The descriptive pupil information appears only for those pupils retained all 
of the first semester. During the first six lessons, it became readily apparent 
that a few pupils were not as handicapped in reading as the screening tests had 
indicated, llierefore, these pupils were dropped and additional pupils from a wait- 
ing list were accepted into the program. Two trainees in the experimental group 
received new pupils, and four trainees in the control group received new. pupils. 
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Table 1 



Backejound Data for All Pupils 



CHILD 



AGE AS OF 
(4-1-76) 



SEK GRADE 



REPEATED TOT. RDG. WOODCOCK INSTRUCTIONAL READING LEVEL 
GRADES SCORES (OCTOBER] (as of January] 

Book Readability Level 



1 9.9 

2 13.3 


M 


3 




\ 1 


\ B Ooen Hiehwavs 


(2.5] 


M 


6 






yi n n H *^ 


n 21 


3 9.8 


F 


3 




7 7 


4.U LtippincoLi Basic kq 


0 fd 0 


4 9.5 


F 


3 






3 D U.n. 


f9 ni 


5 9.4 


W 


2 




2.1 


3 B O.H. 




f nil 

6 9.11 


M 


4 




J 1 V 


d 0 0 H 


' (3.2^ 


7 9.7 


H 


. 4 




3.0 


, 4.0 Lipp. 


(4.o: 


8 9.0 




3 




2.7 


3 BO.H. 


(2.51 


9 10. 4 


M 


3 




2.8 


3 AO.H. 


(2.41 


10 8.3 


M 


2 




1.7 


3 AO.H. 


(2.4; 


11 8.7 


F 


2 




1.6 


1 C 0,Hr^ 


( -s; 


12 8.11 


M 


3 




2.3 


3 B O.H. 


(2.5; 


13 8.1 


H 


3 




2.9 


4.0 O.H. 


(3.2; 


14 3.2 


F 


2 




2.1 


3 AO.H. 


(2.4 


IS. 8.5 


M 


2 




1.2 


1 CO.H. 


( 


16 10.9 


• M 


3 




'1.4 


1 BO.H. 


( -4 


17 9.6 


M 


3 




**2.7 


2 BO.H. 


(2.0 


18 9.4 




3 




2.5 


3 A O.H. 


(2.4 


19 8.8 


F 


2 


1 


1.5 


1 C O.H. 


( -8 


20 12.6 


M 


6 




1.7 


ICO.H. 


■ ( '8 



00 
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*Grades repeated not known, if any. 
'♦♦Woodcock administered January. 
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Instruments 

1. P^rompting Module^ , This is a self-instructional module for pre-service 
trainees and inservice teachers of reading whose pupils are reading from middle first- 
through fourth-grade levels (Brady, 1975). It contains five sections and 16 exer- 
cises. All exercises are on audio tape and are either protocols of the behaviors 
to be learned or exercises in which the respondent has to discriminate between, 
or judge the appropriateness of, certain teaching behaviors. The th«?sis of the 
module is that oral reading giv?s the teacher a unique opportunity to diagnose the 
kinds of strategies a pupil uses to read, including how he/she attempts to figure 
out unknown words and to modify inefficient strategies (such as sounding out, omit- 
ting, naming letters, or failing to self-correct when a miscue does not fit context- 
ually). The module was designed primarily for teachers of mildly handicapped readers 
since such pupils often display dysfunctional strategies of reading (Weber, 1968; 
Levitt, 1972; Dunn, 1954). Completion time is approximately two hours. 

The general purpose of the module is to train teachers in a set of decision 
rules and a repertoire of behaviors to use when responding to pupil miscues during 
oral reading. The repertoire of behaviors was derived from a study of teacher re- 
sponses and pupil miscues in t> aturalistic oral reading lessons (Lynch and Epstein, 
1974), from research in readxiig strategies of handicapped and poor readers (Bie- 
miller, 1970; Cohen, 1975; Levitt, 1972; Weber, 1968), and from teacher behaviors 
suggested in Minicourse 18: Teaching Reading as Decoding (Ward and Skailand, 1973). 
The behaviors used in the module are listed below: 

(1) Respond to pupil miscues that change the meaning of the sentence being read 
and do not respond to those that do not change the meaning of the sentence. 

(2) Generate successful structural pron^Dts. 

(3) Generate successful attention prompts. 

(4) Generate successful pattern prompts. 
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(5) Generate successful phonics prompts. 

(6) Generate successful context prompts. 

(7) Tell the pupil the word if the first two prompts are unsuccessful. 
Definitions and examples of each behavior appear in the Appendix. 

2. Oral Reading Scale (ORS) : This is a criterion test of 29 items accompany- 
ing the module (see Appendix). It tests the respondent's understanding of the 
effects of certain teacher behaviors on the pupil and his/her ability to choose the 
appropriate response, given simulated classroom examples of pupil oral reading. 
The reliability (KR-20) of the measure on a separate group of 23 teachers before 
taking the module was .81, and the criterion reliability, a concept suggested by 
Brown and Pugh (1975), was high. A pretest to posttest comparison, using a depen- 
dent t-test, showed a significant increase in the mean scores (X pre = 19.652; 

X post = 28.043; t = 14.76, df = 22, p < .000) after completing the module. 

3. Concept Analysis Module : This is an audio tape and filmstrip module 
which is part of the series: Preinstructional Competencies for Teachers of the 
Handicapped (Seranel 5 Thiagarajan, 1975). It describes a procedure for the identi- 
fication of important concepts in the elementary curriculum and for analysis of 
each concept in terms of its critical and irrelevant attributes. The objective of 
the module is for trainees to be able to select fundamental concepts for instruc- 
tion, to identify the critical and irrelevant attributes of the concept, and to be 
able to create a set of examples and non-exaniples for teaching and testing. 

4. Instructional Games for Handicapped Children : This is also a mediated 

module of the Preinstructional Competencies for Teachers of the Handicapped Series 

/ . ■ 

(Semmel § Thiagarajan, 1974), in which general principles of modifying and adapting 

instructional games are illustrated. The trainee is required to modify a given 

game using a checklist in a response book, and to adapt another game for teaching „ 

a new topic. Completion time of both modules together is approximately two hours. 

7. 
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5. Oral Reading Observation System (PROS) ; OROS (Brady, Lynch, and Cohen, 
1976) was used to code all oral reading lessons conducted. This low-inference obser- 
vation system is contextually specific to reading, and thus can discriminate between 
patterns of pupil miscues and answers and teacher behaviors occurring during oral 
reading instruction, (See the Appendix for an outline and definitions of all cate- 
gories.) Five coders were trained with simulated and live tapes of oral reading 
lessons for approximately 25 hours. On a simulated criterion tape, given on Nov. 3, 
1975, the mean agreement with the criterion was ,83 (range, ,78 to .88) and the mean 
intra-coder reliability was .89 (range, .92 to .84). (Coefficients reported are 
Flanders* Scott's phi, corrected for chance agreement.) 
Experimental Procedures 

The first six lessons were baseline lessons for both groups. Trainees received 
no specific instruction whatsoever in how to conduct oral reading strategy lessons. 
They were simply told to *'help the child as he/she reads, as best you can.'* Trainees 
were aware that observation data was being collected, but did not know the cate- 
gories and definitions nor the desired behaviors. Trainees were instructed to place 
their pupil at about one level above their instructional level so that there would 
be a total error rate of approximately 10^; and conprehension would be about 70%. 
Adjustments were made throughout the semf/Ster, where necessary, in order to main- 
tain that approximate error rate. 

After the sixth lesson, and prior to the seventh lesson, the experimental group 
received the Prompting module and the control group received two modules: Concept 
Analysis and Instructional Games for Handicapped Children . The total training time 
per group was approximately two hov--^ The training consisted of an introduction 
by one of the experimenters, individual completion of exercises, and discussion 
after each section of the main points of the exercise. Both groups were specific- 
ally told to implement the objectives of the modules in their tutoring. All materials 

■ /■ 
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were collected at the end of the training session, and trainees were told not to 
discuss the content of the training with other trainees, neither those in the same 
group nor in the other group. This was to ensure, as much as possible, no contami- 
nation of treatments. (It also meant, however, that trainees were unable to refer 
back to the modules for clarification as they continued teaching.) 

After the tenth lesson, prior to the 11th lesson, the groups were reversed, 
and each received the training the other group had had earlier. Thus, the control 
group received the Prompting module after lesson 10. All training booklets were 
returned to the trainees at this point, since contamination was no longer an issue. 
A onerweek break for Tlianksgiving vacation intervened at this point. Trainees then 
conducted lessons 11 and 12 before Christmas vacation. 

As stated earlier, observation data were collected on each trainee for lessons 
1-12. Due to mechanical failures, or pupil absences that were unable to be made up, 
not all tutors completed 12 lessons. Data was collapsed and analyzed by time period: 
Trial 1, Baseline (6 lessons). Trial 2 (4 lessons) and Trial 3 (2 lessons). The 
mean number of analyzed lessons for each group at each trial appears in Table 2. 
There is little difference in the two groups. 

All trainees received daily supervision of their teaching and had three indi- 
vidual conferences throughout the semester with one of two siq}ervisors . This super- 
vision and feedback related to all areas of their tutoring performance, except the 
oral reading lessons. Topics discussed were control of the child, management of 
instruction, procedures for administration and interpretation of diagnostic ^md 
evaluation tests, instructional techniques of teaching conprehension lessons and 
word analysis exercises, and lesson plan evaluations. 
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Table 2 

Mean Number of Lessons fcr Trial 1 (Total Possible = 6), Trial 2 (Lessons 7-10, 
Total Possible = 4) and Trial 3 (Lessons 11 and 12, Total Possible = 2) by Groups 







Trial 




Group 


1 


2 


3 


Experimental 


4 


3.2 


1 .7 


Control 


4.1 


2.9 


1 .6 
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Description of Pupil Behaviors 

Tutor-pupil pairs were assigned to groups as a dyad, after ranking tutors by 
the total score obtained on the ORS pretest. Assignment to treatment condition 
was not random. Tlie background data on pupils presented previously, however, re- 
vealed similarity between groups on those pupils' measures. A second important 
consideration, however, was pupil process behavior. For exajn)le, there would be less 
opportunity to prompt if a pupil has a high percent of self-corrections, in which 
s/he corrects his/her own miscues. Likewise, if large differences in error rate 
and words read exist between two pupils, the tutors for those pupils would have 
very different frequencies of opportunity to pron5)t. Requiring an approximate error 
rate of 10% was established to try to control for these variables. 

Table 3 shows means and standard de riations on the following pupil behaviors: 
(1) the frequency and percent of meaning change miscues (21) not followed by a pupi) 
self-correction, (2) the frequency and percent of no meaning change miscues (22) 
not followed by a pupil self-correction, (3) the frequency of words read, and (4) 
the error rate (in percents) by groups and trials. Recall that trainees were to 
prompt only 21 miscues not self-corrected. The frequency of occurrence of this 
measure 'represents trainee opportunity to pron^rt. Table 6 shows variations in the 
frequency of 21 miscues. Across all trials group 1 (^experimental^ , had a mean of 
68.17 and group 2(control), 56.77, showing a slightly higher opportunity to prompt 
for group 1. There are also variations in 22 miscues, but, as trainees were not to 
pron5)t such miscues, opportiinity is probably little affected. iVords read are report- 
ed for infomation simply. There arc also variations in error rates. The mean 
across all trials for group 1 on error rate was 7.9 «Jjid for group 2, 10.2. There- 
fore, group 1 pupils were reading slightly easier ma'cerisil than group 2 pupils. 
The only important difference between the two groups is that gioup 1 appearr^ to 
have had a slightly higher opportunity to px-onipt. Tf \s,- however, was not ' formally 
tested. 



Table 3 

Means and Standard Deviations on Frequencies (Fj and Percents (I) 
for Pupil Meaning Change (21) and No Meaning Change (22) Miscues, 
Mean Frequency of Total Words Read, and Mean Percent Miscues (Error 
Rate) by Groups and Trials for First Seinester 



Variable 


Trial 1 


Trial 2 


Trial 3 


Gl 


G2 


Gl 


G2 


Gl ! G2 


F T 


F' \ 


F S 


F \ 


F . \ 


F \ 


X 

21 

SD 


76.100 83.700 
(53.614) (10,165) 


61.800 c 83.300 
(41.920) f 6.945) 


71.200 82.700 
(43.984) (10,594) 


77.400 86.600 
(74.586) ( 9.215) 


57.200 86.100 
(27.867) ( 8.925) 


31.111 84.666 
(13.995) ( 7.778) 


A 

22 

SD 


21.800 83.900 
(16.239) (12.395) 


15.9CD 84.500 
.(11.836) (10.564) 


20.000 81.300 
(16.819) (13.199) 


14.100 81.000 
( 7.723) ( 9.067) 


13.400 71.800 
(15.276) (32.621) 


6.111 79.222 
( 4,314) (17.654) 


Total 

Words I 

" SD 


825.tl % 
NA KA 


949.9 NA 
NA NA 


865.0 NA 
NA , NA 


784.2 NA 
NA NA 


554.6 NA 
NA NA 


463.6 ^ 

HA NA 


Error 
Rate I 

SD 


NA 7.63 
NA NA 


NA 10.76 
NA NA 


NA 9.192 
NA NA 


NA 8.42 
NA • NA 


NA 6.846 
NA NA 


NA 11.44 
NA NA 



NA = Not Available or Not Valid Score 
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Results 

All data were analyzed by trials; no single lesson analyses were done. The 
sequential list of observation codes for each trial was analyzed by a computer pro- 
gram, written especially for the project. This program constructed two matrices 
through special search n\les of the sequential codes. (See Appendix for an example 
of each matrix.) matrices give information on the frequency and percents of 

all OROS categories, as well as on two-stage chains; teach**r behavior following 
a miscue, and pupil answers following a teacher prompt, tne average length of- 
all tutor-pupil interactive sequences was computed by dividing the total number of 
responses following all miscues by the total number of sequences. Sequences of one, 
in which a miscue was not prompted, were thus included in the computation. 

Since chere was variation in the number of opportunities to respond to mis- 
cues, and thus in the number of prompts uued by each trainee, all frequency data 
resulting from the analysis of the oral reading lessons were transformed to per- 
' antages. The percentage of prompted *'2i'* miscues (meaidng change miscues) was 
determined by dividing ^he number of ' 21** miscues followed by a response, by the 
total number of "21** miscues that were not self- corrected. The percentage cf no 
meaning change miscues (22) prompted was computed in a i^imilar manner. Miscues 
which were self-corrected were thus eliminated from the denominator since there was 
no need for a teacher response to cccur in these situations. The percentage of the 
five module prompts was c^jmputed by dividing the total frequency of each proii?)t by 
the total prompts used.* li^e success rate for each pron^^t was determined by dividing 
the total number of prompts in each category .successfully answered by the pupil, 
by the total prompts given for that category. All non-i?.odnle behaviors in OROS 
were collapsed in an "other** categor)', and a percent "other*' was determined. 

* The su^ii of the frequency of all- module prompts and all non-module prompts were 
divided by total teacher behaviors to determine **percent module'* and "ether.** 



Percentage successful for all pronpts was computed by first eliminating all pupil 
answers following an''*8'* (teacher telling) and then computing the percent of in- 
correct answers (prompts followed by a '*61") and percent of correct answers (proii5)ts 
followed by a "62" or "64"), based upon total answers excluding "8"'s. Success 
rate was, therefore, determined over all pronqpts as well as for module pronpts. 

It was decided to eliminate all, answers^ following "8," since this would inflate 
the success rate because of the certainty of the child responding correctly after 
being told the word on which he/she had miscued. 

The ANOVA and MANCVA tests were run, using percentages of variables for all 
observational data. No transformations of the metric were done. As explained in 
Glass and Stanley (1970), the ANOVA^test is very robust to violations of assump- 
tions, especially when cell sizes are equal, as was the case here. 

Results of information test (ORS) , The first question asked was "Will knowl- 
edge of prompting, as tested in the ORS, significantly increase as^a result of 
training with the Prompting module?" Table 4 shows the individual trainee scores 
on ORS, both pre- and post-module. (Since all trainees were tested immediately 
after receiving the module, the po^^ttest occurred at different dates for the two 
groups.) Using a score of 80% (a raw score of 23) as indicating mastery, all 10 
trainees in the experimental group reached mastery, and seven of 10 reached mastery 
in the control group. Table 5 shows means and standard deviations on ORS by groups 
and trials, trials, and groups. There appears to be a strong trial effect, with the 
pretest trial mean beAng 17.65 and the posttest, 24.8. *rhis was formally tested in 
a repeated measures ANOVA (see Table 6) and substantiated, since trials is signifi- 
cant beyond the .0000 level, with no other source being significant. Therefore, 
the training received with the Prompting module did significantly increase trainees' 
cognitive knowledge of prompting. 
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Table 4 

Individual Tutor Oral Reading Scale Scores,* Pre and Post Module 



Group 


Tutor 


Pretest 


Posttest 




1 


17 


24 




5 


20 


25 




8 


17 






11 


21 






12 


22 




1 


13 
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15 


16 


24 




16 


14 


27 




18 


19 


26 




19 


19 


28 




2 


14 


24 




4 


20 


22 




5 


20 


23 




6 


22 


26 


2 


7 


12 


27 




9 


10 


20 




10 


16 


22 




14 


16 


25 




17 


21 


29 




20 


22 


26 



*Total possible score = 29. 
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Table 5 

Means and Standard Deviations for Oral Reading Scale 
by Groups and Trials (A) 



Pretest Posttest 



Group 1 18.000 25.200 

(2.625) (1.476) 

iN=10 N=10 

Group 2 17.300 24.400 

(4.322) 2.716 

iN=10 N=10 



Means for Ora] Reading Scale by Trials (B) 

Pretest 17.650 
Posttest 24.800 



Means for Oral Reading Scale by Groups (C) 

Group 1 21.600 
Group 2 20.850 



Table 6 



Repeated Measures AN'OVA (Groups by Trials, Pre or Post) 
on Oral Reading Scale Scores 



Source df MS F . P 



Between subjects 


19 


10.6039 






Groups 


1 


5.6250 


.517 


.5123 


SWG 


18 


10.8806 






Within subjects 


20 


31.5750 






Trials 


1 


511.2250 


76.524 


.0000 


GT 


1 


.0250 


.004 


.9506 


Error 


18 


6.6806 
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Results for Trainee Behaviors 

All descriptive information on trainee behaviors are reported in Tables 7, 
8, and 9. Table 7 shows lueans and standard deviations on frequencies; Table 8, 
percents; and Table 9, success rates. (All nuirbers shown represent coding in the 
observation system, ORGS.) Table 8 shows that, with the exception of attention 
prompts (34), module prompts were used less thaji approximately 5% of the time in 
both groups at Trial 1. The total of all module prompts [Tot, Mod.) is 23.8% for 
the experimental group and 33.5% for the control groi^ at Trial 1. Table 9 shows 
means and standard deviations for the percent of successful pronpts for each ORGS 
category. Approximately half or fewer of all pron^Jts were followed by a success- 
ful pupil response. Before receiving any training, therefore, there was little 
use of module prompts, and many teacher behaviors were not followed by a successful 
child response. 

Trainee response to pupil miscues . The fiist observational variables fonaally 
tested were the percent of 21 and 22 miscues prompted by trainees. Table 10 shows 
the results of a 2-way repeated measures multivariate analysis of variance for both 
these variables. No source of variance was significant, therefore, it can be 
concluded thrit the module was not effective in changing the kinds of miscues train- 
ees responded to, for either gro^. Trainees initially responded to a high percent 
of 21 miscues and, thus, did. not need to increase this behavior. Tr.Tine^s, however, 
also responded to a high percent of 22, no meaning change miscues, at Vrial 1 
This behavior was expected to decrease after the module but did not, indz-.ating 
that the module was not effective in changing this behavior. 

Trainee use of prompts . The next set of observational variables of interest 
were the kinds of prompts trainees used. It was hypothesized that trainees would 
increase their use of module prompts, i.e., structural (33), a'itention (34), pattern 
(44), phonics (45), and context (52). The total of ail module prompts (Tot. Mod.) 

c. „ ., . . „ .... ., .... 
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Table 7 

Means and Standard Ueviations on Frequencies of all Teacher 
Prompting Behaviors by Group and Trial for Collapsed Lessons, First Semester 



Dependent Trial 1 Trial 2 Trial 3 
Variables Gl G2 Gl G2 Gl _G2 



* PR 21 X 

SD 


76.100 61.800 
(53.614) (41.920) 


71.200 77.400 
(45.984) (74.586) 


57.200 31.111 
(27.867) (13.995) 


* PR 22 


21.800 15.900 
(16.239) (11.836) 


20.000 14.100 
(16.819) (7.723) 


13.-400 6.J_L1 

(15.276) (4.314) 


31 


3.000 6.700 
(1.885) (5.982) 


4.000 5.500 
(5.053) (4.972) 


1.600 3.333 
(2.756) (4.272) 


32 


.200 .600 
(.421) (1.073) 


.600 .300 
(1.264) (1.828) 


1.600 .111 
(3.657) (.333) 


33 


5.500 8.300 
(5.930) (8.573) 


12.400 11.300 
(12.402) (10.853) 


7.200 6.888 
(10.507) (5.904) 


34 


11. 100 15.500 
(7.109) (9.288) 


14.200 1 .600 
(12.007) (16.439) 


12.200 6.111 
(11.640) (3.179) 


41 


6.400 6,400 
(7.961) (6.131) 


6.500 6.300 
(8.631) (8.056) 


3.700 1.666 
(3.945) (1.936) 


42 


7.400 8.300 
(6.552) (8.069) 


1,500 4.900 
(2.677) (5.237) 


.200 1.000 
^.421) (1.224) 


43 


.400 1.700 
(.690) (4.715^ 


0.0 2.400 

0.0 C6.?a5) 


0.0 .222 
0.0 .441 


44 


1.500 1.300 
(3.135) (1.567) 


5.000 1.300 
(5.477) (1.C./8) 


3.500 1.555 
(3.504) (2.403) 


45 


1.900 4.500 
(3.314) (5.165) 


2.200 7.200 
(2.201) (8.107) 


2.900 4.000 
(5.043) (5.744) 


51 


5.600 5.300 
(7.574) (4.644) 


5.900 5.500 
(3.573) (6.670) 


6.800 3.888 
(9.773) (3.333) 


52 


4.000 2.600 
(3.055) e2.913) 


5.400 2.600 
(4.623) (1.776) 


3.200 l.oor 
(3.259) (l.OOUJ 
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9.200 7.100 
(6.828) (7.57C) 


6.400 6.500 
(5.103) (4.994) 


3.700 3.000 
(2.907) (3.840) 


72 


1.100 i.660 
(1.286) _ (2.366) 


1.300 1.700 
(1.6i6) (1.337) 


.900 2.444 
(2.233) (4.362) 
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10.300 4.400 
(12.356) ' (3.204) 


3.200 5.500 
(2.044) (4.576) 


1.500 2.000 
(i.269) (1.732) 


8 


37.800 22.300 
(56.949) (24.458) 


27.400 30.400 
(22.775) (52.504) 


22.100 7.333 
(16.999) (4.795) 


Tot. Mod 


24.000 32.50G 
(1> 182) (21.589) 


39.200 40.000 
(27.796) (34.260) 


2d.0o0 19.555 
(25.655) (14.371) 


All Other 


58.400 36.400 
(40.008) (2£.650) 


38.4w.i. 4^ 100 
(25.491) (55.189) 


28.200 14.777 
(19.118) (7.965). 



* Miscues pronyted. 
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Table S 

Means (and Standard Deviations) for Percents of all Teacher 
Prompting Behaviors and Length by Group and Trial 
for Collapsed Lessons, First Semester 



Dependent Trial 1 Trial 2 Trial 3 
Variables Gl G2 Gl G2 Gl G2 



* PR 21 T 

SD 


83.7 83.3 
(10.16) (6.94) 


82.7 86.6 
(10.59) (9.21) 


81.1 84.6 
(8.92) (7.77) 


* PR 22 


83.9 84.6 
(12.39) (10.56) 


81.3 81.0 
(13.19) (9.06) 


71.8 79.22 
(32.6) (17.65) 


31 


3.4 5. 
(4.16) (4.11) 


4.3 5.1 
(4.69) - (4.43) 


1.8 6.8 
(3.96) (6.52) 


32 


.200 .^00 
(.632) (.674) 


.600 1.5 
(1.34) (2.2) 


2.5 .777 
(5.63) C2.33) 


33 


5.1 7.8 
(5.19) (7.31) 


14. G 9.9 
(12.64) (7.62) 


8.5 13.44 
(7.18) C8.29) 


34 


11.0 15.9 
(6.11) (6.08) 


13.6 15.7 
(10.85) (7.30) 


15.0 15.1 
(10.9/) (8.32) 


41 


5.5 8.1 
(7.32) (9.59) 


5.9 4.9 
(5.800 (6.31) 


6.8 3.0 
(8.92) (3.74) 


42 


7.0 6.8 
C5.92) (5.65) 


1 . 00 4.3 
'J. .-49) (3.19) 


.100 2.55 
(.316) (3.60) 


43 


.300 .900 
(.483) (2.23) 


0 .800 
(0) (1.54) 


0 . 444 
(0) (1.01) 


44 


.800 1.6 
(1.61) (2.54) 


4.9 .900 
(5.5) (.994) 


6.8 3.22 
(8.33) (5,35) 


-:5 


1.50 4.40 
(2.67) (6.89) 


2.10 5.40 
(2.37) (4.74) 


5.0 5.77 
(11.22) (6.83) 


51 


4.10 5.70 
(3.63) (4.96) 


6.20 4.60 
(3.85) (5.03) 


7.20 8.22 
(10.31) (6.62) 


52 


4.5 1.9 
(4.52) (1.91) 


5.5 3.00 
(3.56) (2.10) 


5.4 2.33 
(8.05) (3.00) 


71 


7.8 8.1 
(3.55) (7.4' 


6.7 6.1 


4.9 5.22 

(7 sni ffi 861 


72 


.800 2.3 
(1.03) (2-26) 


1.7 1.5 
(2.71) (2.06) 


1.2 4.44 

(3.15) (8.35) 


73 


9.7 . 4.4 
(11.53) (4.3^) 


2.9 7.9 
(2.28) (8.62) 


2.0 5.44 
(1.76) (5.96) 


8 


33.0 19;..- 
(23.78) (IS.fcL^ 


21.6 21.60 
(15.35) (16.19) 


28.1 19.0 
(15.47) (15.14) 


Tot. Mod 


23.80 33.5 
(11.83) (14.92) 


41.76 36.'7 
(17.57) (12.02) 


42.10 41.2 
(17,34) (12.55) 


All ther 


52.5 36.3 
- (20.41) (17.05) 


38.0 38.5 
(14.33) (18.29) 


37.1 34.55 
(14.97) (14.01) 


Length 


3.45 3.50 
(1.14) (.761) 


3.28 3.45 
(.769) (.878) 


3.16 3.28 
(.936) (.6139) 



* Miscues prompted. 
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Table 9 

Means (and Standard Deviations) for Percents of Pronpts 
Successful for all Teacher Behaviors by Group and Trial 
for Collapsed Lessons, First Semester 



Depenont Trial 1 Trial 2 Trial 3 

Variable Gl G2 GI G2 Gl G2 



31 X 


45.2 42.2 


45.5 58.1 


41.0 56.4 


32 


10.0 0 

LJi-O^J u 


15.0 14.0 


11.2 11.11 


i3 


54.7 40.6 


60.2 61.5 

(7^ 1 7^ ^^70 


53.8 57.5 
rx^ 771 fxn 7c;i 


34 


54.5 58.2 
iz/.z/i I ID. a/I 


43.9 59.5 

^ (7fi fid^ (Z7 Xdl 


54.6 61.4 

fXX 701 7Q AC 


41 


47.2 48.0 


36.9 34.1 

f^Q A(\\ CkA A^^ 


42.3 19.44 
fd 1 1 "^1 c^n ndi 


42 


42.5 23.5 

C7Q f\\^ (77 \\\ 


18.80 55.6 
C^A 77^ (A\ 771 


10.0 25.77 

f^l A71 r XQ ftQI 


43 


15.0 20.0 

r XX 7 &.\ (A 7 1 


0 (3d.S) 


0 22.22 

fni T-dd HQi 


44 


11,0 49.9 
(7X 'k(\^ r^7 


39.4 29.9 
f42 26^1 f42 111 


46.2 13. jS 

C^R 791 f?! ■?8"1 


45 


10.40 34.7 

f77 ^7^ ( Aft'i 


26.6 37.1 

f28 821 f33 5^1 


27.5 13.44 


5i 


48.9 28.0 


41.6 49.. S 
f40 37"5 f38 221 


39.3 .1.33 

f36 861 r38 821 


- 52 


51.9 37.1 
(38.19) (42.77) 


' 54.3 4y.a 

(37.24) (42.94) 


54.5 2V.7 
(43.87) (44.09) 


71 


28.8 35.9 
(26.30) (34.50) 


40.5 39.0 
(30.49) (39.81) 


53.0 32.44 
(43.92) (42.99) 


72 


37.5 47.4 
(48.94) (37.93) 


25.0 37. S 
(40.82) 48.94 


17.1 17.44 
(36.69) (26.61) 


73 


40.3 48.3 
f37.28) (47.44) 


45.0 75.1 
(44.92) (33.63) 


30.0 42.55 
(48.30) (39.19> 


8 


99.3 96.8 
f2.51) (5.3) 


99.3 99.3 
(1.63) (1,636) 


98.5 100.00 
(3.807) (0) 


Tot. Mod. 


58.1 54.2 
f21.89) (14.55) 


50.7 52.8 
(14.79) (18.17) 


54.9 53.66 
(16.47) (17.83) 


All Other 


73.8 59.6 
fl5.56) (68.40) 


74.3 68.4 
(10.73) (15.84) 


79.3 75.22 
(8.57) (12.17) 


Tot. - 8 


55,1 48.5 
(■16.39) (9.53) 


55.6 52.8 
(7.26) (14.26) 


56.1 56.88 
(13.59) (13.56) 


Tot. All 


70.30 58.3 
(15.37) (13.70) 


6^.0 6i.2 
(10.21) (15.20) 


70. 8o 66.55 
(7.72) (8.58) 



ERIC 



85 



Table 0 

Repeated ''easures VANOVA for PR21 ar.c' rP22 for 
Collapsed Lessons, First Semester (First Roots Only Are Reported) 



Source F dfy df _ n< R (Canonical) 

••rP error 



C'Toxvps .202 2 17 .819 .152 

Trials .800 4 68 .529 .294 

1.047 4 68 .390 .317 
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was also predicted to increase. A decrease was predicted for trainee use of all 
non-nodule rroi:5>ts (other) . 

The first question tested was "Did trainees significantly increase percent 
total moduie?'' Part A of Table 11 reports the results of a repeated measures .ANQVA 
on this variable. Tria?-S is significant (p < .001), while groi^^s-by-trial approaches 
significance (p < .092). Means and standard deviations for Total Module are shov,7i 
in Part 3 of Table 11. Tukey tests on all possible pairs of means (Glass and Stan- 
ley, 1970, p. 383) revealed that Trial 2 was significantly higher than Trial 1 
(p < .05) and that Trial 5 was significantly higher than Trial 1 (p < .05). Trials 
2 and 3 were not significantly different. The cell means are diagrammed in Figure 1. 
The e;q)erimental group increased their use of module proii5)ts dramatically from Trial 
1 to Trial 2 and then maintained their level of use at Trial 3. There is little 
change in the control group over trials. For all trainees taken together, the train- 
ing received with the module did significantly increase total module prompts. The 
training was more effective with the experimental group, however. This group re- 
ceived the Tiodule between Trial 1 and Trial 2 and significantly increased their 
use of module prompts in Trial 2. The control group increased their use of module 
prompts very slightly (37-3 to 41%) after receiving the module. Controls, however, 
had only two lessons subsequent to training as compared to 4 lessons for experiraen- 
tals, and were using more module prompts at Trial 1, baseline, than experimentals. 

Next, six dependent variables were tested in a repeated measures MANOVA: the 
5 module prompts and othf^r. As shown in Table 12, no source of variance is signifi- 
cant, although trials approaches significance (p < .105). Based on this analysis, 
which takes intercorrelations of dependent variables into account, the training was 
not effective in changing the kinds of proripts trainees used. 

Since Total Module was significant for Trials and since Trials approached 
significance frr the MANOVA analysis, a reries of univariate analyses were performed 
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PART A: 



Table 11 

Pepeat'^d Measures .ANOVA for Total 
S!odule for Collansed Lesions First Seraister 



Source 



SS 



df 



MS 



P< 



Between Subjects 



Groups 
S>iG 

Within Subjects 

Tri als 

GT 

Error 



25.387 
7362.801 



1894.998 
573. 713 
3933.637 



1 

18 



2 
2 
35 



25.. 357 
409.044 



947.499 
286.857 
112.390 



.062 



8.430 
2.552 



806 



.001 
.092 



PART B: 



Total Module Trial Means 



Trial 1 28.650 
Trial 2 39.200 
Trial 3 41.684 



S.D. 
fl4.ni9) 

(14.880) 

(14.858) 



Figure 1, 



SO 



Total Module Cell rteans Diagrammed 



Experimental 
Control 



3 
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Table 12 

Rej.eated 'leasures MANOVA for 33, 34, 44, 45, 52, and Other 
for Collapsed I-essons First Fenester (First Poots Only are Pe^^orted) 



Source 




F 






^^error 


/ 

/ 


P (Canonical) 


Groups 


-) 


.050 


6 




13 


.131 


.697 


Trials 


1 


638 


12 




60 


.105 


.584 


CT 


1 


.371 


12 




60 


.205 


.530 
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in order to detemine the effect of the nodule on each behavior when considered 
singly. Sunnary results are shown in Table 15. For groups, no source of variance 
is significant, although context (52) approaches significance (p < .065). For 
Trials, three of the six variables are significant - structural (53), pattern (44) 
and "Other." For the interaction, no source of variance is significant, although 
"Other" approaches significance (p<.098). 

In Table 14 sveans for the previo^os valuables are .^splayed. In r'art A of 
Table 14 are groi^j means for context (52) pron5)t5. The experimental gro'jp 31, used 
approxicately twice as many 52 prompts as the control group, G2. In Table 8, 52 
prompts for Gl was 4.5'« at Trial 1, 3.5% at Trial 2, and at Trial 3, while for 

G2 the means are approximately 2% at each trial. No changes in use of 52 proii5)ts 
occurred as a result of training, therefore. 

In Part B of Table 14 are the Trial means for 53, 44, and other. All possible 
pairs of means for eacli variable were tested with Tukey tests. The o..^y signifi- 
-cant conparison for structural (33) pronpts was between Trials 1 and 2, with Trial 2 
beirg significantly higlfer than Trial 1 (p < .05). Trainees as a whole, therefore, 
doubled their use of 33 pron5)ts during Trial 2 as compared to Trial 1, and then 
maintained the same level of use. This result also reflects the effectiveness of 
the module in changing experimental trainee behaviors since those trainees received 
the module prior to Trial 2. 

For phonic? (44) pronpts, the lukey tests revealed that Trial 3 was significantly 
hi^^her than Trial 1 (p\ .U3), with no other comparisons being significant. This prompt 
was used very infrequently at Trial 1 (1.2*6) and slightly more (5.1%) at Trial 3. 
The module was effective, therefore, in increasing use oi 44 prompts. 

For other prompts. Trial 3 was significantly lower than Trial 1 (p <.05). 
No other Tukey comparisons were significant, Approximatr>ly 44% of all trainee 
behaviors were non-module prompts at Trial 1, while only 36% were non-module at 
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V. 

TaLle 13 



Susriary of Results of kepeated Measures .•SAOVA's for Percent of 
33, 34, 44, 45, 52, and Other for Collapsed Lessens First Seaester 



Source F C<-- 



Groups (1,18) 

33 .163 18.298 .691 

34 .506 85.644 .486 
44* 2.492 73.661 .132 
45 1.031 SI. 632 .323 
52 3.861 108.714 .065 
Other .062 25.387 .806 

Trials (2,35) 



3.475 163.252 .042 

34 .656 14.515 .535 

44 3.653 72.243 .036 

5 1.313 31.058 .281 

2 .381 5.65? .686 

Other 8.459 952.532 .001 

GT (2.35) 

33 2.238 102.003 ' .122 

34 1.239 28.257 .302 

44 1.776 35.087 .184 

45 .376 8.867 .689 
32 .030 .442 .971 
Other 2.483 279.557 -098 
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Table 14 

Means for Selscted Variables Tested 



Part A: 


Context 


ProEpt C523 Means 


Group 


Y 


S.D. 


1 


5.133 


(5.538) 


2 


2.413 


C2.322) 



Part B : Structural (33) PRonics (44) and "Other" Prompts 

_Trial 1 _Trial 2 Trial 3 

Prompts X S.D. X S.D. X S.P. 

33 6.450 (6.328) 11.950 (10.379) 10.842 (7.925) 

44 1.200 (2.117) 2.900 ( 4.363) 5.105 (7.132) 

Other 44.400 (20.106) 38.250 (15.999) 35.894(14.181) 
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Trial 3. The training, therefore, was successful in decreasing use of other pronpts. 

The cell means for other are diagrainmed in Figure 2. In this diagram, the 
experimental group decreased their percent of "Other" prompts from Trial 1 to Trial 2 
and maintained the level at Trial 3. Over the 3 trials, however, the control group 
showed very similar levels of use of ''Other" prompts. As for the variable Total 
Module, the training appears to have been niore effective with the experimental gvoup. 

In considering Tables 11 through 14, it must be concluded that the training 
received through the module was only partially effective in changing proiT5)ting beha- 
viors. Significant interactions, not main effects, had been predicted since the 
module was administered at differential times for the two groups. This was only 
achieved for the variables Total Module and "Other" (p ^.10), but not for any single 
proiiyt. Two individual pror^ts of five did significantly increase across trials. 
The results suggest that the module was more effective with the experimental train- 
ees since Trials 2 and 3 were not significantly different for all comparisons made, 
as would be expected if the module had been effective with control trainees. 

Success of prompts . The purpose of the module was not only to increase trainee 
use of module prompts but to increase the appropriateness of those prompts for pu- 
pils. The decision rules in the module encouraged trainees to focus on pupil beha- 
vior, pupil skills, and textual characteristics in order to select an appropriate 
pronpt. A proxy for appropriateness is whether the prompt was followed by a pupil 
response that answered the prompt correctly or gave the text word on which the pupil 
had previously miscued. Success rate is the percent of prorjpts followed by such 
pupil responses. All vrriables* discussed in the previous section were also analyzed 
for success rate. 

The success rates analyzed were: (1) al 1 prompts used (module and non-module 
minus telling). Table 15, (2) Total Module success rate. Table 16, (3) the five module 
prompts in a MANOVA, Table 17, and (4) the five module prompts separately in ANOVA's, 
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Table 15 

Repeated Measures ANOVA on Total Prompt Success 
Rate (Minus 8's) for Collapsed Lessons First Semester 



Source SS df MS F P< 

Between Subjects 

Groins 127.008 1 127.008 ^ .450 .511 

SWG 5079.308 18 282.184 

Within Subjects 

Trials 206.106 2 103.053 .988 .382 

GT 132.940 2 66.470 .637 .535 

Error 3649.643 35 104.276 
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Table 16 

Repeated Measures <\NOVA for Success Rate of 
Total Module Prompts for Collapsed Lessons First Semester 



Source 



SS 



Between Subjects 

Groups 
SWG 

Within Subjects 



136.448 
5878.926 



Trials 
GT 

Error 



38.582 
22.857 
10,280.400 



df 



1 

18 



2 

2 
35 



MS 



136.448 
326.607 



19.291 
11.429 
29 3.726 



P< 



.418 



.526 



.066 
.039 



.937 
.962 
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Table 17 

Repeated ^!easures WiiOVA for Success Ra-es of 33, 34. 44, 45, 
and 52 for Collapsed Lessons First. Seniester (First Roots Only are Reported) 



Source F df, df p< R CCanonical) 

hyp error r- v / 



f^roups .802 5 14 .566 .472 

Trials .558 IG 62 .841 .378 

GT 1.408 m 62 .198 .545 



ERIC 



96 



Table IS. In Tables 15, 16, 3nd 1*^ t.d sources of variance are significant, Fron 
these analyses, there was no effect on success rate bv the niodjle. In Tabi^ IS, 
only one variable is significant, the interaction for pattern (44) nror-.pts. In 
Figure 5, the diagram shows that the experinental group increased success r^^^ of 
44 proinpts across trials and the control group decreased success rate. Tr\i$ result 
is probably due to instabiiitv of the behavior since the frequency of ^1^4 pra^^ts 
was extremely low, as Table 7 shows. 

It must be concluded from the analyses reported in Tables 14 through l8 that 
the module was totally ineffective in changing success rates of trainee beh^^^iors. 

Length , A final goal of the module was to decrease the length of pranipts, so 
that trainees would not contrive to proir^Jt a raiscue when they were not succe'^sful 
in selecting appropriate prompts to use. The repeated measures A-NOVA reported in 
Table 19 have no significant source of variance. Therefore, the module was ^^ot 
effective in significantly decreasing the average length of prompt sequenced* 
Discussion 

A previous study (Brady, 1976} tested the effects of the Prompting ritiOdule on 
the cognitive and performance behaviors of inservi ce teachers and found jnore signifi- 
cant effects on behavior. The study reported herein serves as a replicaition ^he 
previous study, with a different subject population: pre-service teachers vi^^ t\o 
teaching experience. Two procedural differences in this study were: (I] tha^ those 
trainees given the Prompting module after lesson six were not allowed "^a^ k^ep the 
Prompting module booklet, an:i (2) that a one-week vacation intervened ^te^ -he 
second adrainistratiom of the V rcmpting module, with only two lessons o^^~^ir^-:j^^i after 
the administration r-r. whicii tirtwrs could practice the behaviors taught. ^ot^ o£ 
these procedur^5i ar^ prob. -Me -rplanations for the lack of strong: eife^zx ::Sie 
training on trainees ^"-in^ oehaviors. 

A second issue is f*^^y low percent of each module prompt, v r 
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Table IS 

Susanary of Results of Repeated Measures ANOVA's for 
Success Rates of 33, 34, 44, 45, and 52 for Collapsed Lessons 

First Semester 



Source F (df) MS 



Groups CI. 18) 

SR33 .096 144.903 

SR34 1.290 1127,829 

SR44 .002 3.952 

SR45 .695 927.226 




.761 
,271 
,969 
,415 



SR52 2.299 3376.858 .147 
Trials (2,35) 

SR33 1.284 881,200 .290 

SR34 .360 213.552 .700 

SR44 .107 109.680 .899 

SR45 .811 606.620 ,4- ^ 

SR52 .317 585.391 ,7 0 

f2,35) 

•673 462.203 .316 

•320 1 89 . 66 3 .728. 

6.38 1 6530.605 ..004J 

2.183 1632.455 ,m 

.326 601.032 .724 
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Table 19 

Repeated Measures ANOVA on Mean Prompt. 
Length for Collapsed Lessons First Sesester 



Source SS df MS F P< 



Between Subjects 

Groups .177 1 .17" :13 .741 

SWG 28.219 18 ' 

Within Subjects 

Trials .639 2 . 319 . ' 54 .403 

HT .032 2 .016 . i47 .954 

■rror 11.977 35 .Ml 



-0. 
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exception of attention prosapts which appeared to be a part of the trainees* 

natural repertoire and, therefore, remained stable and high across trials, each 
nodule prompt only occurred approximately 5% of the tine. Thus, four of the module 
prompts, "33'', ''44'', ''45'\ and "52", were not a stable part of the trainees' exist- 
ing teaching behaviors <v the beginning of the 5:tudy. Therefore, the trainees had 
to learn to emit berarior's n^'f' currently a pairt or': their teaching repertoire. Borg 
(1972) stated that "it ii, ^,^K,TeJ:si^ly difficult get a teacher to regularly emit 
specific behaviors that are nrrtr r.i part of his teaching practice" ,(p. 578). It is 
apparent that for pre-se ^ ice -achers, criterrron levels for rhi: h^ehaviors in the 
Pronq)ting module cannot accomplished simpiir thrrough self-inrnrr-uctional techniques 
with no feedback due to t veT>' low use of mciduLc behaviors in naturalistic lessons. 
The CATTS training proiji x,. utilizing an on-izne and delayed cosipirter-assisted feed- 
back on trainee promyrv^.Ts behaviors, was therefor- instituted with the same trainees 
in the second semester: p.tf tJie practicum trainrn: rrogram, in an effort to modify 
prompting behaviors. " is training strategy Ls : ciiported in the next section of this 
report. Chapter III, Section 2, The Effects or Q'vTTS Feedback on Trainee Prompting 
Behaviors . 
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2. The Effects of CATTS and Audio Tape Feedback on Teacher Behaviors 

The use of CATTS in teacher training rests ^pon the assunytion that feedback 
on perforaaace is critical in the development of trainee interactive skills. Under- 
lying this ass-^tion is a aodel of developoent of teaching skills (Sencael, 197S) 
which posits in sequence: 1) trainee ability to discriminate relevant target beha- 
viors; 2) trainee ability to generate relevant behaviors (and concomitantly to ex- 
tinguish irrelevant or undesirable behaviors): and 3) trainee ability to evaluate 
the outcomes of instructional interactions and modulate and adjust behaviors in 
terms of desired pupil outcomes « 

The first stage in the training sequence was, therefore, to provide trainees 
with a program geared to development of appropriate discrimination skills. In the 
present program, this was acconqplished through administration of instructional 
modules (printed manuals) on the Oral Reading Observation System (ORGS) and through 
practice observation training sessions using simulation tapes of teacher-pupil 
interactions during oral reading. 

In the second stage, the focus was on development of s-cills in generating tar- 
geted behaviors. Tc test the effectiveness of real-time feedback in assisting trainees 
to generate appropriate teacher behaviors, half of the trainees in the program were 
provided with CATTS feedback. The capacity of CATTS to provide data on performance 
to the trainee while he/she is still engaged in teaching was seen as an aid to 
increasing the trainees • use of the targeted behaviors. In addition, the CATTS feed- 
back group was provided printout summaries of teacher behaviors after each lesson. 
Thus, the CATTS feedback consisted of provision of both real-time data and post- 
teaching summaries of observation (OROS) data. 

The conpeting hypothesis - that post-teaching verbatim feedback would be as 
effective in trainee generation of target behaviors - was tested by providing half 
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the trainees in the group with audio cassette tapes of their previous lesson. These 
trainees then prepared suancaries of their own prospting behaviors by coding their own 
tapes. Post-teaching replay of audio tapes is probably the most widely accessible 
fora of feedback available to trainees. The relative effectiveness of CATTS real- 
tiBie coded observation data was thus tested against the effectiveness of delayed 
verbatim feedback provided by audio tapes ! 

The third stage of the study focused on the third trainee ability --Eiodulation 
of behaviors in terms of desired pupil outcomes. While it was predicted that modula- 
tion, as measured by success rates of trainee behaviors, would improve as trainees 
improved their ability to generate relevant target behaviors, the provision of feed- 
back specific to success rate was predicted to improve success rate further. In 
the last stage of the study, therefore, trainees received feedback both on genera- 
tion and modulation of appropriate behaviors. Feedback conditions were also switched 
at this point, so that the CATTS group received audio feedback and the audio group 
received CATTS feedback. In this manner, all trainees were exposed to both feed- 
back conditions, enabling the investigators to measure trainee attitudes towards 
each of the two feedback modes. 
Problem Statement 

The purpose of the study was to compare the effectiveness of two methods of 
feedback in changing pre-service teachers' verbal interactive behaviors during les- 
sons in oral reading. The independent variables were time (trials) and feedback 
conditions (groiqps). There were four trials: (1) baseline, a no-feedback condition; 
(2) feedback on behaviors generated, cirst half; (3) feedback on behaviors generated, 
second half; (4) feedback on success rates and generation of behaviors. The two 
groups each received different methods of feedback; Group 1 (CATTS) was given on-line 
TV screen feedback during teaching as well as delayed printout feedback using the 
Computer-Assisted Teacher Training System, during trials 2 and 3. Group 2 (Audio) 



received delayed, self-constructed feedback from audio tapes of lessons taught 
during trials 2 and 3, The dependent measures were (1) percents of target behaviors 
generated, (2) success rates of target behaviors generated, (3) mean length of inter- 
active sequences, and (4) number ^f trials to criterion and number of times criterion 
was reached. Two other measures are also reported, namely, a comparison of CATTS 
and Audio subjects' accuracy in completing Feedback Evaluation Sheets and trainee 
attitudes towards the two feedback conditions. 

The general design for most analyses was a repeated measures design as follows: 
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At the end of Trial 3, prior to Trial 4, feedback conditions were switched, with the 
CATTS group receiving Audio feedback at Trial 4 and the Audio group receiving CATTS 
feedback, (Subjects receiving CATTS feedback for Trials 2 and 3 and Audio only for 
Trial 4 are referred to as CATTS subjects in the reraainder of this report. Those 
receiving Audio feedback for Trials 2 and 3 and CATTS only for^ Trial 4 are referred 
to as Audio.) The informational content of feedback was changed at Trial 4, with 
trainees receiving additional feedback on the success rat^s of the generated behaviors 
as well as feedback on the specific beliaviors generated. This was done in order 
to determine whether knowledge of success oir prompting would aid trainees in gener- 
ation of target behaviors which were appropriate for pupils' needs. 

The general hypothesis tested was that the effects of CATTS feedback would be 
significantly greater than Audio feedback for all dependent measures tested. Spe- 
cifically, it was predicted that subjects who received CATTS feedback at Trials 2 and 
3, when coD5)ared to subjects who received Audio feedback at Trials 2 and 3, would 



(1) generate a significantly greater percent of target behaviors, (2) have signifi- 
cantly higher success rates, (3) have significantly shorter interactive sequences, 

(4) reach the first criterion lesson in significantly fewer trials and have a sig- 

I* 

nificantly greater number of criterion lessons, (5) have more accurate Feedback 
Evaluation Sheets, and (6) have a more positive attitude towards feedback. 
Procedures 

Subjects , The subjects were 19 special education pre-service teachers who 
were participating in a practicum focusing on teaching reading to the mildly handi- 
capped. All were juniors at Indiana University. Tlie practicum ran from Octobor 13 
to April 22, for a total of 19 weeks. The present study was conducted during the 
second semester of the 1975-76 school year, from January 14 to April 22, for a 
total of 15 weeks. Throughout the year, trainees received training and supervision 
in diagnostic and remediation techniques for mildly handicapped readers. During the 
first semester, all trainees received a self- instructional module, Prompting (Brady, 
1975), that contained specific techniques for. responding to pupil miscues during 
oral reading strategy lessons. (See section 1 of this report for a description 
of the effects of instruction with the Prompting module.) 

Trainees were assigned to feedback groups by ranking the average percentage 
of meaning change miscues made by their pupil during the first semester, and then 
assigning every other tutor-pilpil pair to CATTS or Audio Groups. This was done in 
order to ensure, as much as possible, that trainees in each group would have equal 
opportunities to practice the target behaviors, by working with pupils at similar 
levels of reading difficulty. 

All pupils were drawn from regular and special education classes in the public 
schools in Monroe County, Indiana. Criteria for acceptance in the tutoring program 
were as follows: second and third grade pupils reading at least one year below grade 
levels and 4th, Sth, and 6th grade pupils, at least 2 years behind. Priority was 



given to piqpils having difficulty in word recognition, word analysis skills, and in 
using functional decoding strategies during oral reading of continuous text. 

Each pupil was paired with a single trainee who worked only with that pupil 
throughout the whole practicum. Table 1 shows background information on all pupils 
participating in the second semester of the practicum, individually and by groiq)s, 
including actual grade placement in school, number of times repeated, instructional 
reading level, as determined by the Woodcock Reading Mastery Tests (Woodcock, 1973], 
and instructional reading level as of the beginning of second semester, as determined 
by informal reading inventories. As can be seen in Table 1, the mean instructional 
reading level for Audio-group pupils is 4 months higher than CATTS group pupils, and 
mean readability level of materials for the Audio group pupils is 6 months higher 
than that for CATTS pupils. Therefore, Audio pupils appear to be somewhat less 
retarded in reading than CATTS pupils. 

During the first three weeks of the first semester, six of the 20 selected 
pupils were dropped after the diagnostic testing revealed no handicaps in reading. 
These students were replaced with pupils from a waiting list. Four trainees in 
CATTS received new pupils during first semester, as did two trainees in Audio. At 
the end of the first semester, sufficient improvements in reading were manifested by 
one pupil, who was subsequently dropped and replaced. .Two tutors traded children so 
that a severely reading disabled pupil would be better served. Thus, one CATTS trainee 
and two Audio trainees received new pupils at the beginning of second semester. 
Target Behaviors 

The behaviors on which feedback was focused were teacher methods of responding 
to pupil oral reading miscues, as exemplified in the Pron^tin^ module. An extensive 

review of the literature on reading strategies of poor and handicapped readers and 

teacher behavior during reading instruction, as well as observation data from EMR 
and remedial reading classrooms where o^al reading lessons were being conducted, 



Table 1 . 

Background Data on Pupils in Tutoring Program 
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was the basis for the selectiOTi of behaviors. (A review of research may be fcund 
in Chapter II.) The purpose of the oral reading strategy lessons was for trainees 
to modify how pupils responded to unknown words by encouraging pupil use of context 
stxtictural analysis, attention to the whole word, and sound-letter correspondences. 
Application of these strategies was expected to increase pupils' self-corrections, 
the percent of no-meaning change miscues and the perrcervi of substitution miscues. 

The behavioral goals for the trainees for sen^ ' ^eanester were as follows 
(numbers indicate category numbers in tlie observa , rstem used, to be explained 
subsequently) : 

1; Prompt only meaning change (21) miscues. 

2. Do not prompt any no-meaning change (22) miscues, 

3. Increase the use of the five Prompting Module prompts; 

(a) Structural (33). Teacher asks or tells pupil to identify syllables in 
an unknown woVd. 

(b) Attention (34), Teacher focuses the pupil's visual attention on all of 
an unknown word. 

(c) Pattern (44). Teacher gives, or asks pupil to give, a rhyming word or 
word family cue to an unknown word. 

(d) Phonics (45). Teacher gives, or asks for, a phonics rule or sound-letter 
correspondence within an unkho>m word. 

(e) Context (52). Teacher asks for, or gives, information about the meaning 
of the sentence or story in which the unknown word appears. 

4. Increase the total percent in use of all module prompts (Tot. Mod.), i.e., the 
sum of the five behaviors (a through e) listed above. 

5.. Increase the success rate for each module prompt in 3 above. 

6. Increase the success rate for the tptal percent of all module prompts. 

7. Supply the pupil with the target v'ord, if the first two prompts for it are un- 
successful (Length). 

8. Decrease or eliminate all other categories of non-module prompts (Other). 



Observatiw cea and Procodures^ 

The Oral Reading Observation System (OROS) by Brady, Lynch, and Cohen (1976) 
was used to code, all oral reading strategy lessons conducted. OROS is a low-infer- 
ence category system that is' tontextually specific to reading. It discriminates 
between patterns of pupil miscues and answers to prompts and teacher prompting be- 
havior after pupil miscues. Figure 1 lists all categories in the system. (See 
Appendix for a definiriion of all categories.) The third- levr-l codes (direct and 
indirect) for categO' ' 3, 4 and 5 were not used in th'-^ ^^u^r. 

Five coders were t: ined at the beginning of the fir semester with simulated 
and live tapes of oral reading lessons for approximately 25 hours. On a simu- 
lated criterion tape, given on November 3, 1975, the mean agreement with the crite- 
rion was .83 (range, .78 to .88) and the mean intra-coder reliability was .89 (range 
.84 to .92), Coefficients are Flanders' modification of Scott's phi, corrected 
for chance agreement. During the second semester of the practicum, four maintenance 
checks were held, two with simulated criterion tapes and two using actual trainee 
lessons. Table 2 shows the results of these maintenance checks. Agreement on ^ 
live data is lower than that for criterion tapes, as would be expected because of 
the low frequencies in many categories on the protocol tapes. However, the coeffi- 
cients are still quite acceptable, since all but 4 of 29 coefficients were above 
.30, with two of the low coefficients due to equipment failure. 

WitMn scheduling restraints, coders were randomly assigned to trainees for the 
duration of th> ^tudy. Coders were behind a one-way glass in an observation booth 
for all codin^. Trainees were aware that their oral reading lessons were all 
beingv'p^ed since they came to a special booth for all such lessons. All lessons 
were 'coded vXive and directly into a computer, using push-button control panels 
similar to'to^^ All lessons were tape-recorded as a back-up system 

inVcase^af mechanical fall^ 



Category 1: Target Pupil: Exact Oral Reading 



Category 2 : Target Pupil: Miscues 

21_ Meaning Change 

22_ No/Low Meaning Change 



_0 No ResponfJe/Don 't Know 

_1 Sounding or Naming Letter(s) 

2 No/Low Similarity / 

_3 High Similar! ty 

J Dialect Based 

5 Insertion/Omi:nsion 



Category 3 : Teacher: Look Prompts 

Letter Name(s) 
32_ Spelling 
33_ Structural 
34 Attention 



I Direct 
I Indirect 



Category 4 : Teacher: Sound Prompts 

4I_ Isolated Sounds 

42_ Sound Out Word 

43_ Unnatural Stress 

44_ Pattern 

45_ Sounds Within Words/Phonics Rules 



_1 Direct 
2 Indirect 



Category 5 : Teacher: Meaning Prompts 

51_ Word Meaning 
52 Context 



\ Direct 
2 Indirect 



Category 6_ : Pupil: Answers to Prompts 

fncorrect Answer/Word 
Correct Answer 

63 , Self -Correction 

64 Oxact Word/Meaningful Miscue 

65 Mon-target Pupil Prompts/Answers 




Category 7 : Teacherl Feedback and Management 



71 Positive feedback 

72 Negative Feedback 

73 Management 

74 Turns to Another Pupil ' 



Category 8: • Teacher: Telling 



Category 9: Non-Oral Reading/Other 



Figure 1. 

The Oral Reading Observation System Categories: Hull Version 



Table 2. 

Coder A^^eement: Scott's Phi Coefficient:^ 
^^Flander's Modification) 
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Ail t3jss®i±ng was done between 3:3n and 5:30 after school hours. Each trainee 
tutor«a ewo hours a week, one hour each day, either Monday-WednesUlay or Tuesday-. 
ThursdKiK.. Trainees worked in all areas of reading, using a diagnostic-prescriptsive 
MetkM.;o»Tf instruction. Each day, two specific skill lessons, one in word analysis 
and «i.e in comprehension, were taught and one oral reading strategy lesson of approx- 
Imatteiy 15 minutes was .conducted. Materials used for oral reading lessoni. v,,,^rr^ the 
H«u.' jpen Highways (Johnson et al., 1973) and Lippincott Series (McCrackfen m" 
SL^ ^.TT'; pupils read from Open Highways, as did six Audio pupils. '•V;^r tr;;e xc^^^i 
rwas-rr-Aij strategy lessons only, each pupil was placed at a level ap?.v>Tc-jmatMy on« 
issBEdisji; prams l-val above his/her instructional, reading level in -r -hct a suffi 
cient ijiipraeT of nUscues thet needed prompting would occur. Trai were iiustructmd 
to maiatna. a total error rate of approximately 10%. Table 3 she s juyuns and stan- 
dard deviations by grouj^ at the baseline for second semester. Trial 1, for piq>il 
oral reading behaviors - "21" miscues, "22" miscues, self-corrections, and error 
rate'. As can be seen, pupil behaviors are very similar in the two groups. 

The piqjils of CATTS tutors had a higher frequency of 21 miscues than pupils of 
Audio tutors. The means of the other variables are quite similar. Thus, CATTS 
tutors had a potentially greater opportunity to practice prompting as their pupils 
ffliscued more often. Tlie total error rate is, however, very similar for both groups, 
indicating that the difficulty of the materials was about the same. 

There were four performance criteria used in grading trainees during second 
.semester. First, trainees had to conduct 25 lessons over the semester, making ^ 
all lessons missed, resjardless whether it was due to pupil or trainee absvinca. Make- 
up lessons were ordered in such a way as to maintain the sequence of pupil and trainee 
objectives. For exan5)le, if a make-up and regular lesson were conducted in succession 
on the same day, the trainee conpleled all feedback evaluation tasks in the interval 

o 

ERIC 



Table 3. 

Pupil Oral Reading Behaviors by Groun] 
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between the make-xip and r^'^';;U\r ssson. Normall . the trainee took the feedback 
data home (CATTS print -ouii r vuaao tape) and cor^spieted self-evalu-^i.cion procedures 
which were submittec j'ati f^^^f^i-^^u m prior to th<= next lesson, I-n t:he case of make-up 
lessons^ these requirr^T»**ftris ^ts^ completed beU^ lessons. C;ATTS trainees missed 
an avetage of l.S less.-ms and cio trainees mis >!fd an average of 1,2 lessons. For 
the 21 lessons used in this stu an average 0.5 lessons were taught by all 
tutors. Secondly, trainees had ,o complete a- ^ iignments^, including turning in a 
week's lesson plan at the start each week v. ;::ompleting and turning in an analy- 
sis of each oral reading strategy lesson, usin^ v Feedback Evaluation sheet, before 
the next lesson was tauffiit ardly, trainees ^ re required to attemd all meetings 
and training sessions an a to t^rn assignments ir: on time. Last. , trainees were 
rated by a supervisor on teachin;:; performance an;i lesson plan quaxlity. Each trainee 
had three conferences with a superr-isor during tne semester. There was no discussion 
of oral reading lessons during these conferences, or at any ozhe^ time by the super- 
visor. Lessons were not discussed to avoid confounding the study of the effects 
of controlled feedback with supervisory effects. Trainees were told that they 
would not be graded on the quality of the oral reading lessons but only on comple* 
tion of requirements for the lessons. " 
Experimental Procedures 

Discrimination training . Before tutoring commenced for second semester, five 
bi-weekly training sessions were held with all tutors. The purpose of these meetings 
was to introduce the trainees to the uses of feedback in teaching, and to develop 
trainee discrimination skills by learning the Oral Reading Observation System. 
Trainees received the Computer-Assisted Teacher Training System - Trainee Manual I 
and Developing Teaching Skills - Trainee Manual II . The first manual contained the 
following information: The Computer-Assisted Teacher Training System (CATTS), The 
Role of Feedback in Skill Development, Phases of Teacher Skill Development, Feedback 



as a Source for Decision -Making, and the OROS Training Manual - Student Version, 
The student version of the OROS training manual was a shortened version of the com- 
plete Observer's Training Manual (Brady, Lynch, 5 Cohen, 1976) and contained simpli- 
fied definitions and examples of all categories in OROS, as well as exercises to 
complete. All miscue categories were initially presented, but only nine miscue 
categories were used for the discrimination training. Tlie first meeting was devoted 
to the completion of this manual. 

The remaining three meetings, approximately two hours each, wera devoted to 
coding oral reading lessons with OROS, and using Video Tape Recorder Protocol materi- 
als. All trainees received discrimination training. Materials used for training 
were video protocols of oral reading lessons that had also been used to train coders. 
The purpose of the training was for tutors to be able to recognize and discriminate 
between instances of all 32 OROS categories presented. Speed was not emphasized, 
only accuracy of recognition. 

The first criterion test was given after the 4th session. The test required 
tutors to code a video-taped lesson, entering codes on a specially prepared transcript 
which had parentheses at those points where codes would occur. Due to the speed of 
the taped lesson and, possibly, insufficient time for discrimination training, no 
coders reached master)\ Therefore, one additional tri ling meeting was held and 
coders were urged to study their manuals at least two hours before taking the second 
criterion test. 

For the second criterion test, tutors were given a typed transcript of a lesson 
with parentheses inserted where codes were required, and given as much time as neces- 
sary to complete the test. No video was used. Table 4 shows means and standard 
deviations for the second discrimination test on unadjusted scores and on scores 
adj.usted by counting as half correct any code in which the first number of a particu- 
lar category was correct, regardless of the seconc* number. (For example, if a tutor 



TABLE 4. 

MEANS (ANI> STANDARD DEVIATIONS) FOR SCORES ON DISCRIMINATION 'RAINING 
TESTS 1, SECOND SEMESTER, BY GROUP 



Test CTU CTA MODU QMU QM.\ 



Group 1 169.333 
(22.153) 

Group 2 162.000 
(17.670) 



182.556 16.750 

(15.249) (5.600) 

176.900 17.400 

(14.395) (4.377) 



7.625 11.125 

(1.408) (1.126) 

6.800 10.800 

(1.317) (1.932) 



CTU = Criterion Test 2, Unadjusted Score, total possible = 346. 
CTA = Criterion Test 2, Adjusted Score, total possible = 346. 
MODU = Module Prompts Correct, Unadjusted Score, total possible = 38. 
QMU = Quiz, Unadjusted, total possible = 12 

QMA = Quiz, Adjusted, total possible = 12 (repetitions accepted). 



marked "33" for a Teacher Spellings Prompt, actually coded "32, no credit would be 
given for the unadjusted score and a half point would be given for the adjusted score, 
since the first level of the code is correct.) Also, a subscore of only the module 
pronpts was developed from this test by counting the number of correct codes for the 
five module prompts > The scores for the two groups on CTU, CTA, and MODU are all 
quite similar. However, the means obtained by the groups represent a level of mastery 
of only approximately 50% on each test. On the test of module prompt discrimination, 
MODU, the mean was 17 for both groups, representing a percent score of 44. The train- 
ing was, therefore, not very successful in teaching discrimination of behaviors. 
However, the groups are quite similar in their levels of siastery. 

After about the 6th lesson of the second semester, another test was given. 
This quiz simply Jisted protocols of pupils' reading and asked the trainee to write 
a specific module prompt by each miscue. This quiz, therefore, was both a recall 
and a generation test in that trainees had to generate their own prompts to match 
each code. When the unadjusted quiz score was obtained, points were not given for; 
any prompts that were exactly the same as prompts used for another miscue. The 
adjusted score included repetitions. Table 4 also shows these scores. The unad- 
justed mean of approximately 7 for both groups represents 58% of the total possible 
score, showing that tutors were also having a great deal of difficulty in generating 
novel prompts. However, the adjusted score of 11 for both groups represents 92% 
of the total possible score, showing that trainees could generate prompts when given 
an ORGS code. 

As a check that there was no significant difference between the CATTS and Audio 
subjects in the in/:onnation gained from the discrimination training, analyses of 
variance were rtm on all five scores. These are shown in Table 5. There are no 
significant differences between the two groups. Therefore, it can be concluded that 
both groups were equally proficient in their ability to discriminate and generate 



Table 5 

Repeated Measures ANOVA's for Scores on all 
Discrimination Training Tests, Second Semester, By Group 



.(Variable) Source df SS MS F p < 



(CTU) Between 1 254.737 254.737 .643 .434 

Within 17 6736.000 396.235 
Total 18 6990.737 



(CTA) Between 1 151.509 151.509 .691 .417 

Within 17 3725.122 219.125 
Total 18 3876.632 



(WDU) Between 1 1.873 1.878 .077 .785 

Within 16 391.900 24.494 
Total 17 393.778 



(.(^^) Between 1 3.025 3.0250 1.642 .218 

Within 16 29.475 1.8422 

Total 17 32.500 



(Qm) Between 1 .469 .469 .177 .680 

Within 16 42.475 2.655 

Total 17 42.944 



prompts: Because of the low proficiency level that tutors had in discriminating 
all OROS categories and generating novel module pronpts, several changes were subse- 
quently made in the experiTOntal procedures. 

While the discrimination training wis being completed, trainees taught the 
first four lessons of second semester. These four lessons comprise the baseline 
period. No feedback or instructions as to how to prompt were given during this 
period. At the end of the biseline period, all tutors met as a group and received a 
second manual. Trainee Manual II: Developing Teaching Skills . The first section of 
this manual reiterated the teacher behavior goals in the Proiig)ting module. The 
second section of this manual was designed tcr teach trainees how to interpret the 
computer print-outs summarizing their teaching behaviors during all of the lessons 
taught during first sen^ster, a total of 12 for those who had no absences. A sanple 
of a print-out with no information is given in the Appendix, along with a key 
to each item of information on the print-out, and how it was computed. 

Trainees were required to graph performance data on their first semester les- 
sons, to interpret what took place, and then to set goals for themselves for second 
semester. Some of this information was managerial, such as the length of time of 
the lessons, and the pupil error rate. Other information related to the behavioral 
goals of the Pronq>ting Module and required trainees to state whether their goal for 
second semester should be to maintain a behavior, increase it, or decrease it. 
After the graphing and completion of the items requiring evaluation of behaviors, 
tutors were placed in two feedback groups: CATTS and Audio. 

Feedback procedures . CATTS tutors received a detailed explanation of the kind 
of feedback they would be receiving during and after every lesson. One aspect of 
the feedback was a real-time feedback display of the frequencies of the pron5)ts 
being used. Figure 2 shows a sample of the information that appeared on a video 
screen during every lesson whenever a tutor was receiving CATTS feedback. The first 
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five numbers at the bottom of each column represent the ORGS codes for the module 
pronqpts (the target behaviors); 0 represents Other (all non-module prompts except 
"8"), while "8" is teacher telling. The height of the bar graphs represents the 
frequency of each behavior. In the sample, the tutor has given five "33" prompts, 
two "34" pron5)ts, six "44," five "45," and one "52" proii?)t. Tellxng has been used 
three times and Other, eight. Every time one of the codes at the bottom of the 
display was entered in the button box by a coder, the bar graph would increase in 
height by one unit. Thus, if the next prompt used by the tutor in the sample dis- 
play was a "52," the bar for "52" would increase in height. CATTS tutors were told 
that their goal during^ each lesson was to generate each of the module prompts at 
the same frequency and to have no or few prompts in the "Other" and "8" colixmns. 

The second aspect of the CATTS feedback was delayed print-out feedback. At 
the end of every tutoring session, all CATTS tutors received a summary of their 
lesson, as shown in the Appendix. Before teaching their next lesson, tutors were 
required to interpret the print-out and to complete the Feedback Evaluation Sheet, 
shown in Figure 3. Tutors were also required to establish their own teaching per- 
formance goals for the next lesson they would teach. These procedures were all 
explained to the CATTS subjects during a group meeting. 

Concurrently, a meeting was held with the Audio stbjects only, in order to 
instruct them in the nature of their feedback. At the end of each tutoring session 
Audio subjects received a cassette tape of th€ lesson taught that day. Before the 
next lesson, they were required to listen to the tape and code it themselves, using 
the form in Figure 4, and then to complete the Feedback Evaluation sheet, the same 
one used by CATTS subjects. Performance goals were the same as for CATTS trainees 
to increase module prompts and decrease other behaviors. These procedures were all 
explained to the Audio subjects during the meeting. 

Feedback conditions began for all subjects with lesson 4, with all tutors 
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Figure 3. 
Feedback Evaluation Sheet 



Naae " Pupil Date of Lesson 

Type of feedback CATTS I I AUDIO I I 



THIS lESSOH 






NbXT LESSON 








Increase 


Decrease 


Maintain 


1. Length of lesson (ainutes) 










2, Number of words read 












3. Difficulty level fTjJ^fe^ - 


% 








4. No« of pupil 21 miscues 








V ^ 




5. No. of pupil 22 miscues 








>< 


>< 


6. No. 21's pron^ted _ 








7. No. 22*s proiH5ted 








8, Average length of proiq>t sequence 




















9. Use of Strategic Pronpts 


frequency 


percentage 








(52) Context 












(33^ Structural 












(44) Pattern 












(45) Phonic 












(34) Attention 












Other prompts 












8's, Telling 
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Figure 4. 
Audio Tape Tally Sheet 



Tutor 



Pupil 



Date of Lesson 











Pi^il Miscues 




Proi^ted? 




21 - Meaning Change 


total 


YES 


total 


NO 


total 












22 - No Meaning 
Change 


- 











Pronpts Used 



Frequency 



Context 52 








Structure 33 








Pattern 44 








Phonic 45 








Attention 34 








Telling 8 








Other 








TOTAL 




100 



12, 



completing Feedback Evaluation sheets showing their goals for lesson 5. Therefore, 
lesson 5 was considered the first feedback lesson. After the feedback conditions 
had continued for lessons 4 and 5, it became apparent to the experimenters that the 
tutors were having difficulty attempting to generate all five module prompts at 
once. (The results of the quiz discussed earlier corroborates this.) For that 
reason, several lessons at a time wefe devoted to generating only one module pronpt, 
with those previously practiced being continued. Tutors were told that their goal 
in teaching should be to generate each module prozT5)t approximately 15% of the time, 
and have at least 75% of their prompts be module prompts. These figures were estab- 
lished as criterion percents. 

Since the pronpting module states that '-52" (Context) is the roost important 
pronqjt, this was the first behavior practiced singly^ A training session was held 
with all tutors (CATTS and Audio) for the purpose of defining "52" prompts, showing 
written exasnples and having the tutors generate several different '*52'V prGn5)ts 
appropriate to a sample of pupil miscues. Any questions about '*52'' pronp'cs were 
discussed and answered. For lessons 6 through 11, tutors were to try to practice 
only -•'52** pron5>ts (if another module prompt was more appropriate in a certain in- 
stance, then the tutor was to use it). At this time the tutors were also given a 
line graph showing the percent of both '*52" and total module pronpts that they had 
used in their first six lessons. They were required to continue filling in this 
information for each lesson, beginning with lesson 7, for the remainder of the se- 
mester so as to heighten their awareness of the target behaviors and their teaching 
goals. A sample graph is shown in Figure S. 

After the eleventh lesson of the second semester and prior to the twelfth 
lesson, a second meeting was held to discuss the remaining module pronqpts« Written 
exanples were provided for categories *'45" (sounds within words), ''33'' (structural), 
and "44" (word families, patterns) in that order. One prompt, "34" (attention). 
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«s not included because the first senester data indicated that trainees were sble 
to gOTerate a criterion level of '•34'»s by the end of first seoester. Again the 
tutors were asked to generate several examples of each nodule proinpt appropriate 
to the sai:5)le pupil miscues. In the following weeks, the tutors practiced each 
of these module prompts singly for two lessons (first "45"5, then "33"s, then "44"s) 
and maintained their generation of "52" prompts. Focus of lessons 1 through 17 is 
listed below: 

Lesson Focus 

1-3 Overview of OROS. Discrim- 

ination training completed. 

4-5 All 5 nodule prompts 

6-11 52, context prompts 

12-13 45, phonics prompts 

14-15 33, structural prompts 

16-17 44, pattern proaipts 

Feedback switch ♦ After lesson 17 and prior to lessooi 18, all tutors received 
an evaluation form designed to measure their attitude towards the feedback condition 
they had received to that point. (See Appendix for sample form.) Then feedback 
conditions were switched, with all the CATTS tutors receiving audio feedback and 
all the Audio tutors, CATTS, for the remaining four lessons (lessons 18 through 21), 
A training meeting was held with each group to explain the feedback procedures which 
were the same as in the meetings described previously. One addition was made in the 
information given in the feedback and for the teaching goals - the success rate of 
each module prompt was included. A successful pron5)t was one followed by a "62" 
(Correct Answer) or "64" (Exact Text Word). For the CATTS trainees, the instantan- 
eous visual display resembled the sample in Figure 6, If all the proiT5)ts given for^ a 
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specific category were successful, the bar graph would be co-npletely filled. If 
three out of five procpts were successful, the bar graph would be three- fifths filled. 
This information was added cumulatively to the visual display, with appropriate 
changes in the display occurring each tine one of the module proOTts occurred md 
was either successful or not. The Audio tally sheet and CATTS feedback sheet, 
revised to include success rates, are shown in Figures 7 tmd 8 respectively. Both 
groiq)s of trainees were told to continue to generate module pronpts and to choose 
those most likely to be followed by a successful pupil response. Before pron5)ting, 
they were to consider the pupil 's reading skills, the kind of miscue made, the word 
on which the miscue was made and the sentence (story) in which the miscue appeared. 
These procedures were followed for lessons 18-21. 

After the last lesson of the second semester (lesson 23), the trainees again 
received a questionnaire on their attitudes toward feedback, similar to the first 
questionnaire. This evaluation, however, also asked for tutors to coii5)are the two 
methods of feedback. (See Appendix for sa!i5)le questionnaire.) 

As indicated earlier, trainees were required to make up any absence, and 
almost all tutors . completed 20 or 21 lessons; thus both groins had equal opportu- 
nities to practice prompting. 

Summary of feedback phase of training . All trainees received feedback on all 
dependent measures in the study. However, due to time constraints and established 
priorities of the program, there was some differential enphasis between performances. 
Variables emphasized in the training meetings and feedback content were: 

1. percent of 5 module prompts 

2. total module prompts percent 

3. success rates of each of 5 module prompts 

4. success rate of total module prompts 

5. percent "Other" prompts. j 

V 
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Figure 7. Audio Tape Tally Sheet, 
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FecdbncJc Eval-i?-ti- -i Sl-.e-rt 
Nane ^V/V KTiV /K Pu^ll iTiarK- Date cf Lo..cn^A^7^ 

Type of Feedback CVHC M-IO }C 



THIS 










',FXT l:.sso 


_ 1 








; 
1 


i 


Decreacf? | 


Ma in *T in i 




Lon^^^h of ] - sscTi nutos 










2, 




I I ^ 






-J 


3. 


C: ff icultv level ( ... 












A 


No. of pup-1 21 nii^cjos / f 




.. 







r 

• 


No, of piTil 22 nl-: catr^ 














Kg. 21 prr-npr^^d 


31 


















G. 


rvevj-Z ' leii^^th cf p.'^"npt 
















— — — 






0 • 






Percentage 


J 








{::) Context 


"5- 












cess fill I'unil 
R- ^--«-. (02 or i 


y 


JIX 








i' 


(33) rtru-"''-^l 1 




^^AA 






I 


! ' 

i 
} 


Success :ul ! 


a... 


O 




r ■ 


(44) Pre.- cm 






i 






1- ^ 

j S-jcc^.ssful r_.oil 






i ^ 






r 

i 






1 ? 




L 




1 Succ-5S^tvl I rpil 


o 


c 




1 




! -^^^ ' .. . /ion 




1 z^- 








1 
t 
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P.osponrC" ; or O-I ' 


3 


1 
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Figure 8. Feedback Evaluation Sheet. 



Less enphasis was placed on the following performances: 

1. number of lessons in which the criterion percent was reached 

2. length of prompt sequences 

3. kinds of miscues to prompt. 

The performance results obtained reflect the differential emphasis and will be dis- 
cussed in the results section which follows. 
Results 

Performance data . Before any analyses, the observation data from each indi- 
vidual lesson was collapsed into four trials. Lessons 1-4 were collapsed into the 
baseline tri?l fTrial 1), lessons 5-10 into the generation- first half trial (Trial 
2), lessons 11 to 17 into the generation-second half trial (Trial 3), and lessons 
18 to 21 into the success rate trial (Trial 4). 

Procedures used for computing percents are described in the Results section of 
Chapter III, part 1. 
Percents of Target Behaviors Generated 

Table 6 shows means and standard deviations for the frequencies of all teacher 
prompting behaviors by Group and Trial, and Table 7 shows the same information on 
percents. 

As can be seen from the^.:; tables, there is little difference between the two 
groins at Trial 1* Two of the module prompts, ''33'* and "34," were already at or 
near criterion at Trial^ 1 before feedback began. Three of the module prompts were 
occurring at a very low percent - "44," "45," and "52." Neither group had a total 
module percent of over 50%, and both were using approximately 30% other prompts, 
fairly equally distributed across all categories. The average interaction sequence 
-following a miscue was approximately 3.5 for each group. 

In order to check that the assignment to groups procedure resulted in equiv- 
alent initial trainee behavior in each group, one-way analyses of variance (CATTS 
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Table 6 

Means and Standard D#!viations on Frequencies of Module Prompting 
Behaviors by Group and Trial for Collapsed Trials Second Semester 



Dependent 
Variables 



Trial 1 
Gl G2 



Trial 2 
Gl G2 



Trial 3 
Gl G2 



Trial 4 
Gl G2 



V27 PR21 X 
SD 



V29 


PR22 


V37 


31 


V39 


32 


V41 


33 


V43 


34 


V^S 


41 


V47 


42 


V49 


43 


• 




V51 


44 


V53 


45 


V55 


51 


V5 7 


52 


V61 


71 


V63 


72 




73 




8 



Total Mod. 
All Other 



70.333 
(45. 191) 
16.222 
(15.896) 

5.444 
( 2.877) 
5.222 
( 7.838) 
17.222 
(12.336) 
17.333 
(13.076) 

6.666 
( 4.924) 
.777 
( 1.641) 
0 
0 

4.555 
( 4.034) 

4.111 
( 4.044} 

8.666 
( 8.660) 

5.444 
( 5.502) 

7.444 
( 7.418) 

1.222 
( 1.301) 

5.222 
( 3.898) 
21.666 
(24.728) 
48.666 

(::i.30i) 

35.555 
(30.06 7) 



67.300 
(36.138) 

12.900 
( 6.789) 



5< 
( 5< 



500 
482) 



1.500 
( 2.460) 
14.200 
(10.086) 
15.600 
(12.859) 

5.800 
( 8.904) 

2.100 
( 3.956) 
.500 
( 1.581) 

3.500 
( 3,566) 

3.900 
( 3.909) 

7. 100 
( 8.130) 

7.000 
( 9.683) 

6.900 
( 4.557) 

1.000 
( 1.885) 

4.100 
( 2.282) 
15.000 
( 9.321) 
44.200 
(26.317) 
27.000 
(11.737) 



162.333 
43.243) 
26.888 
15.078) 
8.777 
5.190) 
5.444 
4.824) 
31.222 
21.498) 
23.666 
11.800) 
11.000 
10.920) 
2.111 
3.655) 

.555 
1.130) 
9.333 
7.314) 
12.111 
8.237) 
26. Ul 
14.181) 
28.777 
18.060) 
9.222 
/t.603) 
3.777 
4.893) 
7. 888 
6.660) 
38.000 
21.558) 
105.111 
36.350) 
59.000 
23.859) 



146.700 
56.403) 
30.400 
13.9S3) 
7.700 
4.644) 
2.200 
3.910) 
26.700 
13.776) 
27.600 
21.427) 
7.600 
11.471) 
2.500 
3.274) 
.400 
.966) 
15.400 
19.861) 
13.700 
10.89 3) 
20.400 
13.014) 
32.300 
20.232) 
11.000 
6.036) 
2.000 
3.559) 
8.600 
.6.203} 
31.800 
28.997) 
115.700 
40.348) 
53.400 
31.805) 



139.000 
46.548) 
30.222 
11.882) 
8.000 
5.809) 
1.777 
1.787) 
37.555 
10.875) 
28.444 
18.682) 
9.777 
8.105) 
1.111 
1.166) 
.111 
.333) 
16.777 
7.446) 
18.333 
7.106) 
17.555 
12.768) 
26.444 
13. 884) 
4.555 
2.877) 
7.222 
7.918) 
5.555 
4.824) 
23.888 
16.676) 
127.555 
29.428) 
41.222 
18.362) 



114.200 
30.491) 
26.000 
12.771) 
5.200 
5.287) 
1.600 
1.837) 
24.100 
14.540) 
23.300 
17.801) 
6.600 
5. 168) 
.300 
.483) 
.100 
.316) 
10.200 
8.854) 
9.400 
6.518) 
18.100 
15.926) 
29.100 
19.324) 



400 
777) 
400 
477) 
900 
508) 
23.400 
13.549) 
96.100 
39.014) 
38.100 
20.920) 



97.555 
(37 . 340) 

16.111 
( 7.975) 
4.444 
( 2.788) 
.777 
( 1.641) 

27.666 
(14.195) 

18.535 
(13.7214) 



666 
905) 
222 
441) 



0 
0 

14.222 
(13. 131) 
12.555 
( 2.242} 

5.111 
( 4. 728) 
27.111 
(20.865) 
5.333 
( 5.916) 

5.555 
( 3.711) 
3.777 
( 5.09 3) 
24.111 
(14.030) 
100.111 
(54.459) 
38.778 
(21.747) 



90.300 
(37.650) 
16.100 
(1 1.522) 
4.600 
( 3.777) 
1.500 
( 2.273) 
28.800 
(14.420) 
16.500 
( 8.236) 

5.600 
( 5.037) 
0 
0 
0 
0 

10.000 
{ 9.153) 

12.500 
(10.638) 

4.600 
( 3.373) 

20 . 800 
(10.293) 
4.600 
( 3.373) 
1.700 
( 2.540) 
5.000 
( 3.018) 

16.700 
(10.011) 

88.600 
(31.280) 

28.000 
(13.621) 



Trial 1 =• lessons 1-4, baseline 

Trial 2 = lessons 5-10, feedback 

Trial 3 3 lessons 11-17, feedback • 

Trial 4 « lessons ).8-21, switch mode of feedback 



Gl = CATTS. feedback group 
G2 = Audio feedback group 
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Table 7 



^<oans and Standard Deviations for Percents of >bdule Prompting 
Behaviors and Length by Group and Trial for Collapsed Trials, Second Semester 



Dependent 


Trial 1 


Trial 2 


Trial 3 


Trial 4 


Variables 


Gl 


G2 


Gl 


G2 


Gl 


rj2 


n 

U 1 




V28 PR21 X 


86. 777 


85.600 


:15, 888 


85 .000 


85 . 444 


OH . U WW 






V30 


SD 


( 8.408) 


( 8.435) 


( 5.372) 


( 6.960) 


( 6^002) 


( 9.057) 


( 9. 798) 


( 7.859} 


PR22 


90.666 


85. 700 


87.555 


86. 100 


88. 333 


84 . 100 


83 000 

U ^ • www 


86 .700 


38 




( 9.233) 


(12.046) 


( 7.384) 


( 6.967) 


( 5.074) . 


( P. 492) 


(1 1 . 874), 


(10 .573^ 


31 


5.222 


5.300 


3.888 


3.600 


3.555 - 


2. 300 


2. 777 


3 . 200 


40 




( 4.176) 


( 4.217) 


( 2.891) 


( 3.306) 


( 3.745) 


( 2.162) 


( 1.715) 


( 2!859j 


32 


3.000 


1. 100 


1 .888 


.700 


.555 


.600 


. 555 


.800 


42 




( 3.741) 


( 2.469) 


( 1.833) 


( 1.337) 


( .726) 


( 1.075) 


( 1.333) 


( 1 .316) 


33 


15.777 


14.200 


1 3.0UO 


1 2 . 800 


17. 777 


1 3. 800 


IS. Ill 


21 .100 


44 




( 7.446) 


( 5.028) 


( 6.041) 


( 6.356) 


( 3.383) 


( 5, 138) 


( 7.817) 


( 7.922) 


34 


15.666 


18.300 


10. 777 


13.300 


12 . 777 


1 3 . 300 


1 1 .666 


13. 100 


46 




(10.332) 


(11.314) 


( 5.309) 


( 8.138) 


( 7.644) 


( 8.982) 


( 6.745) 


( 7.563) 


41 


5 .666 


4 . 900 


4. 222 


2 .500 


4 .000 


3.300 


2.888 


3.800 






( 5.522) 


( 6.919) 


( 3.929) 


( 3.407) 


( 3.122) 


( 2.710) 


( 4.196) 


( 3.583; 


48 


42 


.666 


1.400 


.666 


.600 


.222 


0 


.111 


0 






( 1 . 322) 


( 2.836) 


( 1 . 322) 


( 1.075) 


( .441} 


0 


( .333) 


0 


50 


43 


0 


.800 


.111 


. 100 


0 


0 


0 


0 






0 


( 2.529) 


( .333) 


( .316) 


0 


0 


0 


0 


52 


44 


3.666 


3. 100 


4.111 


5.700 


8.222 


5.600 


8.000 


6.300 






( 3.391) 


( 2.6S5) 


( 3.444) 


( 5.869) 


( 4.437) 


( 5.541) 


( 4.636) 


C 5.271} 


54 


45 


4.111 


3.900 


5.222 


6.300 


8.444 


5.700 


9,000 


8.800 






( 4.675) 


( 3.875) 


( 3.113) 


( 4.900) 


( 2,403) 


( 4.785) 


( 3.605) 


( 5.633) 


56 


51 


6.300 


6.333 


11. 333 


9.400 


7.111 


11.600 


2.888 


3.100 






( 4.899) 


( 7.874) 


( 5.522) 


( 5.929) 


( 4.621) 


(12.606) 


( 2.713) 


( 2.514} 


58 


52 


4.666 


6.300 


12.888 


15.800 


12.666 


16.700 


15.555 


14.800 


62 




( 4.031) 


( 7.134) 


( 7.928) 


(10.293) - 


( 7. 158) 


(11. 106) 


( 8.353) 


( 7.465) 


71 


6.666 


6.600 


4.000 


4.800 


1.777 


3.200 


2.777 


2.600 






( 5.408) 


( 4.452) 


( 2.692) 


( 2.780) 


( 1.201) 


( 2.529) 


( 2.166) 


( 1 .776} 


64 


72 


.606 


.900 


1.222 


.500 


2.888 


1.000 


3.444 


.700 






( 1.000) 


( 2. 183) 


( 1.922) 


( 1.080) 


( 3.887) 


( 2.000) 


( 2.697) 


( 1.251- 


66 


73 


6.111 


4.600 


3.666 


3.500 


2.777 


2.900 


2.000 


3.500 






( 8.894) 


( 2.988) 


( 4.821) 


( 2.415) 


( 3.961) 


( 2.726) 


( 3.201) 


( 2.368} 


70 


8 


15.888 


16.600 


16.777 


13.700 


10.888 


13.700 


15. Ill 


12.300 






(10.469) 


( 8.566) 


( 8.348) 


( 7.902) 


' ( 6.641) 


( 6.929) 


( 7.928) 


( 6.430} 




Total 


45.555 


47.700 


47.888 


56.000 


61 .666 


56.900 


64.333 


66.000 


76 


Mod. 


( 8.805) 


(10. 770) 


( 9.879) 


(10.604) 


( 5.147) 


(16.569) 


(11.726) 


( 7.571} 




All 


30.555 


29.800 


27.111 


24.100 


19.555 


21.900 


24.444 


20.400 


80 


Other 


(12.258) 


( 8.297) 


( 9.829) 


( 6.919) 


( 8.156) 


( 8.089) 


(1 1.237) 


( 7.183} 


112 


Length 


3.441 


3.703 


3.344 


3.45 3 


3.528 


3.434 


3.638 


3.547 




C .490) 


C 1.455) 


C .518) 


C . 727) 


( .571) 


( .819) 


( .914) 


( .661) 
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vs. Audio) were run using baseline trial data on the percent of each module prompt 
and the total module percent. Table 8 shows the results of these ANOVA's, No sources 
of variance are significant; therefore, groups were not significantly different on 
these variables at Trial 1. 

Miscues pron^ted . Tlie first variable tested was the percent of "21" miscues 
pronqjted and the percent of "22" miscues prompted. Trainees were to respond to "21" 
miscues and not to respond to "22" miscues. Table 9 shows the results of the multi- 
variate analysis of variance on these two variables. No sources of variance were 
significant. Table 7 shows that trainees in both groups continued to prompt both 
••21" and "22" miscues at a high percent across the four trials. Therefore, the 
feedback conditions were not effective in decreasing the percent of "22" miscues 
prompted. It must be added that only the delayed feedback for each group contained 
information about these variables and that performance on these two variables were 
emphasized very little in comparison to the emphasis on generating module prompts. 
Total Module Pronyts 

The second variable analyzed formally was the total percent of module proiq)ts 
used. Table 10 shows the results of this analysis, in which only "Trials" is 
significant (p < ,001). Therefore, trainees significantly increased their use of 
module prompts across the semester, regardless of the feedback condition they re- 
ceived. The two feedback treatments, therefore, were equally effective in increasing 
this behavior. Trial means and standard deviations are shown for this variable in 
Part B of Table 10. Tukey tests between all possible pairs (Glass and Stanley, 
1971) revealed that the comparisons between Trials 1 and 3, 1 and 4, and 2 and 4 
were significantly different (p < .05), while those between Trials 1 and 2, 2 and 3, 
and^3 and 4 were not. Therefore, trainees needed at least two trials to signifi- 
cantly increase their total percents of module prompts used. These results also 
indicate that trainees were able to maintain their behavior even under a different 
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Sununary of One Way ANOVA'S for Trial, Collapsed Baseline, Lessons 1 Through 4) 



for Second 


Semester for 


"33", 


"34", 


"44", "45", 


"52", and 


Total 


Module 


Variable 


Source 


SS 


df 


MS 


F 


PC 


33 


Between 


12 , 


.800 


1 


12 .800 


.343 


.565 




With in 


671 , 


,200 


18 


37.289 






34 


Between 


33, 


.800 


I 


33.800 


.303 


.589 




Within 


2006, 


.200 


18 


111.456 


e 




44 


Between 


1 


.800 


1 


1 .800 


.206 


.655 




Within 


157 


.000 


18 


8.722 






45 


Between 




.200 


1 


.200 


.012 


.915 




Within 


309 


.800 


18 


17.211 






52 


Between 


12 


.800 


1 


12.800 


.392 


.539 




Within 


58 


.820 


18 


32.678 







Tot. Mod. Between 16.200 1 16.200 .174 .681 

Within 1675.000 18 93.056 
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Table 9 

Repeated Measures MANOVA for PR21 and PR22 
for Collapsed Trials, Second Semester (First Roots Only Repeated) 



Source F df df , p R (Canonical) 

Hyp error 

Croups .017 2 16 .98:5 .046 

Trials 1.187 6 100 .319 .354 

GT .702 6 ino .648 .243 
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Table 10 

Repeated Measures ANOVA for Total Module 
for Collapsed Trials, Second Semester (A) 



Source 


SS 


df 


MS 


F 


P 


Between Subjects 










Groups 


60.634 


1 


60.634 


.278 


.605 


SWG 


3704.156 


17 


217.892 






Within Subjects 










Trials 


3727.724 


3 


1242.575 


15.640 


.001 


CIT 


393.571 


3 


131.190 


1.651 


.189 


Error 


4051.956 


51 . 


79.450 








Trial 


Means 


(And Standard Deviations) 




Trial 


1 


2 


3 




4 




■46.7 


52.2 


59.2 




65.2 




(9.7) 


(10.8) 


(12.5) 




(9.5) 
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node of feedback, as occurred at Trial 4. If this had not been the case, a group 
by trial interaction would have occurred in which CATVS trainees would have de- 
creased their percent total module at Trial 4, during which lessons they received , 
audio feedback, and audio trainees would have decreased their percent total module 
at Trial 4, when they received CATTS feedback. 

The mean for total module at Trial 4 is 65%, 10 percentage points under the 
criterion of 75% set by the experimenters. This could be due to the method of com- 
puting the percentages. The total frequency of all teacher behaviors was used as 
the denominator, therefore, including category seven codes in OROS, which are manage- 
ment and feedback codes, as well as 8, teacher telling. Some of these teaching 
behaviors are obviously necessary during any type of lesson. As measured in this 
study, however, trainees as a whole did not reach criterion for this variable. 

MANOVAs . A multivariate analysis on the five module prompts and "Other" was 
also run. The results are in Table 11. Again, only the trials source of variance 
is significant (p < .001). Therefore, when intercorrelations among the dependent 
variables are taken into account, both feedback conditions were equally effective 
in increasing the percents of modulo prompts used and decreasing percent Other. 
The interaction term is not significant; thus, the change in feedback conditions 
did not affect trainee behavior. 

In order to consider the effects of feedback on individual behaviors, univari- 
ate ANCVA»s were conputed on these 6 variable-- 5 module prompts and Oth^^ Mmanary 
results are shown in Table 12. For all variables, neither groups nor the interaction 
term are significant, showing equal effectiveness of feedback condition and no effect 
for switching feedback. Of the six variables tested for trials, one, "34" (Attention), 
was not significant, though it approached significance (p < .08). 

In Part B of Table 12, trial means and standard deviations are reported for all 
six dependent variables. Attention prompts, "34," decreased almost 5% across trials, 
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Table 11 

Repeated Measures MANOVA for "33", "34", "44", "45", "52", 
and "Other" Prompts for Coll?psed Trials, Second Semester 
(First Roots Only Repeated) 



Source F df df p R (Canonical) 

' hyp error 



Groups 


.546 


6 


12 


.764 


.463 


Trials 


4.746 


18 


130.593 


.001 


.819 


(IT 


.737 


18 


130.593 


.768 


.395 
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. Table 12 

Summary of Repeated Measures ANOVA'S for "33", "34", "44", "45", 
"S2", and "Other" Prompts for Collapsed Trials, Second Semester (B) 



Source 

— — , 


Variable 

■ ■ 


1 


Croup 




' , 

.223 






. 370 






.245 




A C 


.131 






.40'.) 




Othci* 


.295 


1 ria 1 


33 


3.885 




34 


2.377 




4-1 


5.083 




45 


7.063 




52 


12.965 




nther 


15.864 


(IT 


1 

33 


1.013 




34 


.112 




44 


1 . 5,2 1 




45 


■ 1.066 




52 


.634 




ntl\er 


1.676 



— — 


. = — 

MS 




(1.17) 




• '.1*4 O 




59. 883 


sm 




1 2 . 896 






. 1 1 2 


• /«.«. 




72,458 










(3.51) 


153.697 


.014 




100.263 


.081 




5g.32P 


.002 




80.526 


.001 




't09.298 


.001 




1242.399 


.001 


(3.51) 


40.061 


. 395 




4.707 


.953 




15.615 


.220 




12.1S6 


.372 




20.028 


.596 




131 .292 


.184 



r'eans (and ' Standard Hevkitions) (B) 



Variable 

33 
34 

44 ' 
45 
52 
Other 



Trial 
1 

14. 9( 6.2) 
17.1(10.5) 
3.4( 3.0) 
4.0( 4.2) 
5.5( 5.8) 
52. 4( V.7) 



12. 9( 6.0) 
12. 1( 6.9) 
4.9( 4.8) 
5.8( 4.1) 
14. 4 ( 9,1) 
46.8(10.8) 



15. 7( 4.7) 
13. 1( 8.1) 
.8( 5.1) 
.0( 4.0) 
14. 8 ( 9.4) 
39.8(12.5) 



6, 
7, 



19.7(7.8) 
12.4(7.0) 
7.1(4.9) 
8.9(4.7) 
15.2(7.7) 
33.8(9.4) 
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as they should have, given the high percentage of "34" prompts used during the 
baseline period. A decrease in this trainee behavior was necessary if an increase 
in other behaviors was to occur. 

The remaining 5 variables were all quite significant across trials. Tukey 
tests were, therefore, computed on all possible pairs of trial means for each vari- 
able. For structural, "33" prompts, only the comparison between Trials 2 and 4 
was significant (p < .05), a difference of 7%. Thus, trainees significantly in- 
creased their percent "33" prompts from 12.9% at Trial 2 to 19.7% at Trial 4, 
regardless of feedback condition. Since the mean percent of "33" prompts across 
all trainees was already at criterion (15%) during the baseline period, the finding 
of only one significant comparison is not surprising. 

For pattern, "44" pronqpt^^ the comparisons between Trials 1 and 3, 1 and 4, 
and 2 and 3 were significant. Sincp f^'^ t\v >->sons eh^Ji^^izing "44" prompts did 
not occur until i rial 3, thi^ rciuult was to be expected. At Trial 4, the mean 
for "44" was 7.1%, approximately half of the established criterion of 15%. Trainees, 
thus J had difficulty in generating "44" prompts. 

For phonics, "45" prompts, the comparisons between Trials 1 and 3, 1 and 4, 
and 2 and 4 were significant (p < .05). At Trials 1 and 2 trainees generated ap- 
proximately 4,5% "45" prompts and significantly increased this percent to approxi- 
mately 7% at Trials 3 and 4. Again, "45" proii5)ts were not emphasized until Trial 3; , 

» 

thus, this result could be anticipated. 

J. For "52," context prompts, the comparisons between Trials 1 and 2, 1 and 3, 
and 1 and 4 were significant. Trainees increased their use of "52" prompts from 
5.5% at Trial 1 to 14.4% at Trial 2 and maintained this level across Trials 3 and 4. 
Most lessons during Trial 2 were practice lessons for "52" pronqjts; thus, the signi- 
ficant increase in trainee behavior from Trial 1 to 2 shows the effects of the focus 
on "52." 
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The significant comparisons for "Other" prompts were between Trials I'and 3, 
1 and 4, and 2 and 4. Across Trials 1 and 2 trainees generated approximately 50% 
••Other" and decreased their use of "Other" prompts to approximately 35% across 
Trials 3 and 4. 

Only one prompt significantly increased after baseline Trial 1, "52" prompts 
(from 5.5% to 14.4%). Then, a near criterion mean was maintained across Trials 
3 and 4. Trainees were told to concentrate on generating "52" pronpts only for most 
Trial 2 lessons. Thus, this significant increase shows that the goal of only 
focusing on "52" did change performance. Most other significant increases occurred 
at Trial 3, the trial that included lessons emphasizing "45," "33," and "44." No 
significant comparisons between Trials 3 and 4 were found. Therefore, performance 
was maintained at Trial 4, even though the mode of feedback was switched (CATTS to 
Audio feedback and vice versa) . 

Length . The mean length of the miscue-teacher pron^t-pupil answer interaction 
sequences was also tested. The results are shown in Table 13. No sources of vari- 
ance were significant. Therefore, subjects did not decrease length over the semester, 
nor W5.S there any difference across the two groups. Again, as for the two variables, 
"21" and "22" miscues, length was not a goal that was emphasized as much as gener- 
ating the five nodule prompts. 
Success Rates of Target Behaviors Generated 

The third set of variables of interest were the success rates of the target 
behaviors. Success rate was con^juted separately for each pron^jt category by divid- 
ing the frequency of the prompts followed by the pupil giving a correct answer or 
the exact text word by the total prompts for the category. Table 14 shows the 
means and standard deviations for the success rate of all OROS prompt categories. 
Success rate was tested across all four trials, even though feedback information 
on it was given during each lesson only during the Trial 4 lessons. Tutors received 



Table IS 

Repeated Measures ANOVA on Mean Prompt Len^;th 
for Collapsed Trials, Second Semester 



Source SS df MS 



Between Subjects 

Croups .O.JO I .040 .0?4 

S^vn 28.. 146 17 1,607 

U'ithin Sul)iects 

Trials .45S 3 ,152 .410 

^'t* .^^2.-^ 3 .141 .382 

Hrror 18.851 51 .370 



Table 14 



Means and Standard Deviations for Success Rate of 
Teacher Prompts tor Second Semester by Troup and Trials 



Dependent Trial 1 Trial 2 Trial 3 Trial 4 

Variables CI n2 Q C2 CI C,2 C,\ C2 

31 ^ 44.111 39.300 48.666 42. $00 S3. Ill 54.300 27.444 26. 100 
SD ^:S.687) (23.847) (23.048) (29.937) (23.449) (34.548) (33.234) (24.950) 

32 '7. 066 29.500 34.222 43.900 33.333 22.000 22.222 17.000 
{yc.SS'n (42.466) (36.293) (44.861) (35.355) (34.254) (44.095) (29.051) 

33 54.111 50.000 43.388 43.000 50.666 55.100 SB. 000 54.600 
(13.251) (28.543) (18.496) (16.431) ( 7.193) (17.239) (12.165) (18.608) 

3^ 47. Ill 56.300 52.555 48.400 51.444 49.200 43.444 ' 48. 100 

(26.241) (26.499) (14.009) (12.946) (13.830) (21.384) (14.213) (17.270) 

44.555 30.600 47. 888 38.500 44. 888 43.700 34.444 43. 50^) 

(30.216) (33.470) (31.230) (28.551) (25.154) (30.298) (33.941) (28.402) 

42 2.777 17.700 9.666 51.100 37.000 10.000 11.111 0 
( 8.333) (33.493) (19.887) (43.164) (48.435) (31.622) (33.333) 0 

43 0 10.000 14.777 20.000 llMll IC.OOO 0 0 
0 (31.622) (33.770) (42.163) (33.333) (31.622) 0 0 

44 43.111 16.100 63.444 59.500 52.888 64.900 66.888 54.200 
(36.957) (19.547) (23.590) (30.030) (26.050) (26.459) (20.220) (32.737) 

45 47.888 36.800 40.666 49.600 37.777 33.300 48.883 38.100 
(32.884) (32.220) (20.451) (31.945) (11.766) (30.703) ( 9.033) (13.186) 

51 28.222 34.300 49.111 44.800 49.333 43.900 52.888 35.800 
(23.610) (33.944) (16.389) (24.371) (19.384) (20.452) (36.060) (34.784) 

52 38.888 23.400 45.333 46.700 53.777 47.500 48.888 46.400 
(31.880) (22.623) (15.668) (20.055) (11.616) (19.580) (14.615) (11.852) 

71 39.333 53.200 43.666 35.300 31.111 32.100 26.333 40.100 
(33.064) (45.716) (26.405) (21.587) (34.440) (37.696) (42.614) (38.587) 

72 38.777 15.000 32.777 7. 700 2$. 222 9. 100 37.777 30. 700 
(42.443) (33.747) (34.520) (16.438) (29.894) (19.301) (30.605) (42.583) 

73 31.111 39.000 73. 888 56.600 53.555 79.200 40.666 34.100 
(39.431) (45.813) (35. 190) (35. 103) (43.872) (31.332) (4 7.265) (45. 157) 

8 98.555 95-500 98.777 99.700 96.888 96.700 94.666 95.500 

( 2.697) ( 7.663) ( 1.563) ( ,948) ( 5.134) ( 4.083) ( 7.483) ( 5.562) 

Tot. Kod, 50.222 44.900 50.111 49.800 50.666 52.900 52.777 50.200 

(13.581) (14.448) (9.816) (12.787) (6.8-3) (7.651) (9.601) (11.242) 

All Other 63.555 68.700 66.333 66.200 65.555 66.800 66.777 68.200 

(9.015) (15.670) ( 8.170) ( 8.599) (11.587) ( 9.065) (11.008) (12.899) 

Total-8 49.555 48.400 49.888 49.300 50.222 52.300 50.222 49.800 

(10.736) (14.206) ( 7.540) (10.842) ( 7.774) ( 7.181) (10.756) ( 9.126) 

Total All 58.444 57,000 58.111 57.100 56.000 58.400 57.222 55.900 

( 6.385) (12.445) ( 7.440) ( 8.359) ( 5.979( ( 7.089) ( 9.510) ( 6.871) 
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feedback on success rates during each lesson at Trial 4. This procedure allowed 
the analyses to determine if improvements in generating prompts would result in 
increases in success rates when Trials 1, 2, and 3 only were considered. Compari- 
sons between Trials 3 and 4 would reveal the effect of feedback including this 
information on trainee performance. 

Only the success rates of the total module percent and the five module 
prompts were tested formally. Success rates at Trial 1 were approximately 40-50% 
for these variables for both groups, with the exception of the Audio trainees 

success ra te s-foir-'*44>*-and-^'S2''-^^16%~and 23%, respectively;^ Approximately half 

or fewer of the pronpts for each category, therefore, were successful at Trial 1. 

Table 15 shows the results of the ANOVA on the success rate of the total per- 
cent of the module pro^^>ts. No sources of variance are significant. Therefore, 
the feedback conditions were ineffective in increasing the total module success 
rate over trials. 

The success rates of the five separate module proB5)ts were analyzed multi- 
variatel)l[ Table 16 shows the results, in which only the Trials source of variance 
is signiricsint. Thus, when a multivariate analysis is performed on the success 
rates of the 5 module prompts, there is no effect for feedback condition, or the 
feedback by trials interaction. 

Univariate analyses were then run for all five variables. The results are in 
Table 17. Again, only "Trials" was significant, though not for all variables. 
Therefore, trainees significantly increased success rate across trials for 3 vari- 
ables, with no differences in effect occurring due to feedback condition. Tukey 
tests between all possible pairs were run for the significant variables, "33," 
"44," and "52," For "33" pron^Jts, the only significant comparison was between Trials 
2 and 4 (p <C .05), an increase of 43% to 56%. For "44," con5)arisons between 1 and 2, 
1 aiid 3^ and 1 and 4 wero significant (p< .05). The success rate of "44" prompts 
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Table IS 

Repeated Measures A.NOVA for Success Rate of Total 
Module ProTBpts for Collapsed Trials. Second Semester 



Source 55 



Between Subjects 

Sr^' '^2. 316 1 42.316 135 

S]VII___ .5334,78^,--- j7 313.811 

Within Subjects 

Trials 227.568 3 75.789 l 27i 

147.420 3 49.140 '824 

terror 3042.211 51 59.651 
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Table 16 

Repe&ted Measures MANOVA for Success Rates of 
33, 34, 44, 45, and 52 for Collapsed Trials, Second Semester 
(First Roots Only Are Reported) 



Source F df, df P R (Canonical) 

nyp error ir v ^ 

Groups .735 5 13 .610 .469 

Trials 3.078 15 130.148 .001 .678 

GT .803 15 130.148 .673 .409 



Table 17 

Suimary of Repeated Measures AN'OVA-S for Success Rates of 
33... ..34... ..44.., ..45... and ^'S2" for Collapsed T.ials. Secon. Semester CA) 



Source 



Croup 



Trial 



GT 



Variable 



53 
34 
44 
45 
52* 

33 
34 
44 
45 
52 

33 
3t 
44 
-15 
52 



F (df) 



MS 



•029 (1,17) 


18 


.635 


.095 


65, 


.629 


.985 


1185, 


• OCl 


.154 


154. 


.501 


2. 144 


620. 


.•409 


2.809 (3,51) 


566, 


.224 


.509 


128, 


.364 


7.683 


4688, 


.667 


. 309 


152, 


.961 ' 


3.623 


1485. 


,211 


•5S2 (3,51) 


71. 


,009 


.717 


180. 


886 


2.070 


1263. 


579 


.922 


456. 


108 


.602 


246. 


952 



p< 



.867 
.764 
.335 
.700 
.161 

.049 
.678 
.001 
.819 

.019 

.788 
.546 
.116 
.437 
.616 



Trial Means (and Standard Deviations) 

33 51.9(22.1) 43.4(16.9) 53.0(13.3) 

28.9(31.5) 61.4(26.5) 59.2(26.3) 

52 .0.7(27.8) 46.1(17.6) 50.5(16.2) 



56.2(15.6) 
60.2(27.6) 
47.6(12.9) 



154" 
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increased from 29% at Trial 1 to 61% at Trial 2^ and was then maintained. For ''52" 
pronqpts, only the coicparison between Trials 1 and 3 was significant, an increase 
from 31% to 51%. The success r?tes for *'34/' approximately 50%, and that for "45," 
approximately 40%, did not significantly change over trials. 

Increasing success rate was, therefore, a more difficult task than increasing 
the percent of each prompt generated, since there are fewer significant comparisons 
across trials for success rate. Success rates were not included on the Feedback 
Evaluation sheets until after Lesson 17; neither were they included on the instantan- 
eous and delayed feedback for the CATTS group until after Lesson 17. Therefore, 
only during Trial 4 lessons did tutors receive feedback on success rates, while 
feedback on prompts generated was given for two trials, Trials 2 and 3. For the 
three dependent variables on which multiple con5)arisons were computed^the coii5)ari- 
son between Trials 3 and 4 was not significant for any of the variables. This sug- 
gests that the increase in trainee ability to generate the targeted behaviors con- 
tributed to the increase in success rate, since trainees didn't significantly 
increase their success rates when this information was included in the content of 
the feedback. Alternatively, this could be due to a practice effect^ since only 4 
lessons were devoted to feedback on success rate, while 13 lessons were devoted to 
feedback on behaviors generated. 

The success rate of all pron^^ts used was also analyzed. Category "8," or tell- 
ing, was not included since telling generally results in a success rate of 100%. 
The results are reported in Table 18. Nothing is significant; therefore, trainees ' 
did not increase their total success rate (minus 8's) across trials, nor was there 
any difference between the two feedback conditions. 

Number of Lessons to First Criterion Lesson and Number of Lessons at Criterion 

As stated earlier, trainees were told that the crite:ion level of performance 
was at least 15% for each module prompt and a total of approximately 75% for all 
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Table 18 

Repeated Measures ANOVA on Total Proinpt Success 
^Rate (Minus "8.S...3 for Collapsed Trials. Second Semester 



Source 



SS 



Between Subjects 



Croup 
SKG 



.009 
4 502.622 



Within Subjects 



Trials 
HT 

Error 



37.197 
29.253 
2371 .800 



df 



. 3 
3 
51 



US 



1 .00V 
17 264. 8G0 



19.nf)6 
9.751 
46.506 



.000 



.4 10 
.210 



,9ns 



,747 
889 
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EDodule prompts. These levels were established by the experimenters for several 
reasons. First, equal proficiency in all pron^Jts was desired. Secondly, it was 
not considered desirable for trainees to extinginsh ali behaviors other than module 
procpts, since certain behaviors in category 7, such as praise and management, and 
in 8, telling, should naturally occur during teaching, especially with handicapped 
readers as those in the tutoring practicum. 

The number of lessons to the first criterion lesson for each prompt was ob- 
tained by counting the number of lessons a fter Lesson 4 in which the criterion level 
was reached, since feedback began at Lesson S. For exajrtple, if Lesson 5 was a 
criterion lesson, the tutor's score was 1, and if Lesson 7 was a criterion lesson, 
the score was 3. Only Lessons 5-17 were included, because feedback conditions were 
the same across these lessons. Only subjects who reached a criterion lesson be- 
tween these lessons were included. Table 19 shows means and standard deviations 
on the raw data for the six variables. Due to the nature of the metric, a square 
root transformation (VY + .5) (Kirk, 1968) was used to normalize the data. Table 
20 shows means and standard deviations for the transformed data. One-way ANOVA*s 
(CATTS vs. Audio) on the transformed data are reported in Table 21. Only the 
'Total Nfodule" variable is significant. CATTS trainees took significantly longer, 
almost five lessons longer, to reach the first criterion trial of 75% for Total 
Module prompts. Therefore, Audio feedback was more effective in getting trainees to 
a first criterion trial in the shortest time. It must be pointed out that the cri- 
terion of Total Module could be obtained by a tutor having, say, 55% "34" prompts 
and 5% for the other -4 module prompts, an undesirable behavior. More important is the 
number of lessons needad to achieve criterion for the module prompts.) For those 
5 ANOVA's there was no difference between the two groups in number of lessons to 
criterion. Therefore, the two feedback conditions were equally effective in assist- 
ing trainees to reach criterion for the 5 module prompts. 
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Table i9 

Means (.And Standard Deviations) for Number of Lessons 
to First Criterion Lesson for 33. 34. 44, 45. 52. and Total 
Module Prompts for Lessons 5 Through 17. Second Semester, on Raw Data by Groups 



Variable 


Group 1 (Audio) 
n=10 


Group 2 (CATTS) 
n=9 


33 


2.40 (1.96) 
(N = 10) 


3.33 (2.55) 
N = 9) 


34 


3.0 (3.42) 

(N = 8) 


4.00 (4.18) 
(N = 9) 


44 


3.17 (2.14) 
(N = 6) 


6.40 (4.39) 
(N = 5) 


45 


4.43 (4.65) 
(N = 7) 


7.67 (3.83) 
(N = 6) 


52 


2.50 (1.96) 
(N = 10) 


4.13 (3.98) 
(N = 8) 


Tot. Mod. 


4.13 (4.19) 
(N = 8) 


8.86 (2.04) 
(N = 7) 



•Tutors who did not reach criterion were not involved in calculation of mean 
nuini>er of lessons to first criterion. 
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Table 20 

Me^^s Standard Deviations) for Number of Lessons 

to First Critr^ri'^n Lesson for 35, 34. 44, 45, 52, and Total Module Prompts 
for Lessons 5 'Through 17, Second Semester, on Transformed Data by Group 



Variable Group 1 (Audio) Group 2 (CATTS) 



33 


1.62 


(.54) 


1 .87 


(. 


61) 




(N' = 


10) 


(N' = 


5) 




34 


1.''3 


(.75) 


1 .95 


(. 


88) 




(N' = 


8) 


(N = 


9) 




44 


1 .85 


(.52) 


2.50 


( 


.89) 




(N = 


6) 


(N = 


5) 




45 


1.99 


(1.04) 


2.78 


( 


.70) 




(N' ^- 


7) 


(N = 


6) 




52 


1 .66 


(.52) 


2.02 


( 


.78) 




(N' = 


10) 


(N = 


8) 




Tot. Mod. 


1.97 


(.93) 


3,05 


( 


.31) 




(N' = 


8) 


(N = 


7) 




lTran.s format io" used was 


= .5 
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Table 21 

Way ANOVA'S for Nuir.ber of Lessons to First Criterion Lesson f 
4, 44, 45, 52, and Total Module Prompts for Lessons 5 Through 
17, Second Semester, on Transformed Data 



Variable 


Source 


df 


ss 


F'S 




r 


P 


33 


Between 

Within 

Total 


1 
i 

17 

18 


.2892 
5.64 89 
S .9 380 


.2892 
.332 3 




.870 


.364 




ViO r on 

Mthin 
Total 


1 

15 
IG 


.2010 
10.2264 
10.4273 


.2010 
.6818 




.255 


,595 




Between 
Totnl 


1 

n 

10 


4.5559 
5. 7109 


1.1550 
.5062 


2 


.282 


.165 




Within 
Total 


1 
11 
12 


1.99 78 
9.0139 
11.0117 


1 .99 78 
.8194 


2 


.438 


.147 




Between 

Vatlun 

Totnl 


1 

16 
17 


.5339 
6.6414 
7.2252 


.5839 
.4151 


1, 


.407 


.253 




Between 

H'ithin 

Total 


1 
14 


4.3280 
6.6008 
10.9238 


4.3280 
.5078 


8. 


,524 


.012 



The ninnber of lessons in which the criterion nerfonnance level was reached was 
also determined. For this, any tutor who never reached criterion was assigned a zero 
score; therefore, all subjects were included in this analysis. The means and standard 
deviations are reported on raw data in Table 22 and transformed data in Table 23, Table 
24 reports the results of the one-way .WOVA's. Significance was not reached for any 
of the six variables. Therefore, there was no difference in tne two feedback condi- 
tions in the total number of lessons during which criterion was reached. 
Year Performance Data 

In order to determine whether or not any differences existed between the effec- 
tiveness of the two feedback conditions across the whole year of the practicum, anal- 
yses were also run on selected target behaviors across the year. Five trials were 
formed by collapsing the 33 lessons (12 lessons conducted during first semester with 
no feedback and 21 during second semester with 17 having feedback) into five trials • 
Trial 1 was lessons 1-6, first semester; Trial 2, lessons 7-12, first semester; Trial 
3, lessons 1-4, second semester (baseline); Trial 4, lessons 5-10, lessons on gener- 
ating prompts (first half); Trial 5, lessons 11-17, lessons on generating prompts 
(second half). Thus, the lessons in which success rate feedback was presented and 
feedback conditons were switched were not in the 5 trials. Assignment of subjects 
to groups was done twice, once at the start of the first semester study, and a second 
time at the start of second semester. The composition of the groups, therefore, 
changed at the beginning of the present study. For the year analyses, first semester 
group assignments were ignored and group members were assigned to subjects on the basis 
of the treatment, received during Lessons 5-17 of second semester, with CATTS designated 
Group 1, and Audio, Group 2. 

Means and standard deviations for the variables analyzed for the year data are 
reported in Table 25. The mean percents of the five module promnts generated and 
total module prompts increased across trials for both groups, while the total of "Other" 
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Table 22 

Means (And Standard Deviations} for N'umber of Le« 
Criterion was Reached Between Lessons 5 and 17. Second Semester, 
for 33. 34. 44. 45. 52, and Total Module Prompts on Raw Data by Group 



Variable 



33 
34 
44 
45 
52 

Tot. Ftod. 



nroup 1 (Audio) 1 Croup 2 (CATTS) 



5.30 (3.83) 4.f.7 (3.12) 

1-70 (2-36) 1.73 (1.99) 

1- 5" :i-90) 1.56 (1.13) 
5.80 (4.10) 5.22 (3.56) 

2- 80 (2.86) 1.33 (i.oo) 



1 

N = 10. 
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Table 23 

Means (And Standard Deviation?) for Na-r.ber of Lesson? Criterion was Reached Between 
Lessons 5 and 17, Second Seriestcr, for "33", "34", "44", "45"', "52", 
and Total Module Proi?.pts on Iransforried Data^ by Group 



ERIC 



Variable Hroup 1 (Audio)'^ Crou]* 2 (CATPS)^ 



= 10. 

3 

N = 9. 



1 1 , 

Transformation used was X = v X + .5 



16 



2-25 (.92) 2.16 (.74) 

1-31 (.74) 1.36 (.69) 



^■^ 2.4 1 (.45) 2.37 (.33) 
34 

44 

1.27 (.66) 1.37 (.44) 

52 2.34 (.86) 2.24 (.88) 

Tot. Hod. ' 1.66 (.79) 1.30 (.40) 



Table 24 

one Way A.VOVA.S for .Vunber of Lessons Criterion vas Reached Between 
Lessons 5 and 17. Second Semester, for "ZZ", •■34-, -44-. ..45". '.52-. 
and "Total Module" Pror.?ts on Transformed Data 



Variable 


Source 


df . 


SS 


MF 


F 


P 






Between 

Within 

Total 


1 

17 
18 


.0-104 
2.9G33 


.0104 
. 1737 


.OGO 


.809 






Within 
Total 


1 

17 
IS 


.n3.-?2 

11.9887 
12.0219 


.0332 
.7052 


.047 


.831 






»' ji cn 1 n 
Total 


1 

1 7 
18 


.0144 
8.7073 
8.7217 


.0144 
.5122 


.028 


. 869 






Between 

Within 

Total 


1 

17 
18 


.0514 
5.4 813 
5.5327 


.0514 
.3224 


.160 


.695 






fietween 

Within 

Total 


1 

17 
18 


- .0735 
12.7678 
12.8473 


.0795 
.7510 


.106 


.749 






Within 
Total 


1 
17 
18 


'>976 
G.3765 
7.4741 


.5976 1 
.4045 


.477 


.241 
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lable 25 



Means and Standard Deviations for Variables 
Analyzed for Year Data by Group and Trial 
(Reported in Percents) 



variable' J^^, ^ 



C! 02 CI 



9 900 12.600 15.778 14.200 13.000 12.800 17.778 U. 

( 9 0981( 9.098) ( 7.446) ( 5.029) ( 6.««)('-3») ' ' ' 

\6.430 13,400 15.667 18.300 10.778 13.30 /■ /■ 

( 8.984) ( 8.540) (10.332) (11.314) ( 5.310) ( 8." ) 

3.000 4.100 3.667 3.100 4.111 5.700 . ■ 

( 3,621) ( 5.131) ( 3.391) ■( 2,685) ( 3.444} ( 5.870) (,■ )(■ ) 

2 000 6 400 4.111 3.900 5.222 6.300 8.444 5.70 

( , )(i!51) ( 4.676] ( 3.872) ( 3.114) ( 4.900) , UWl^ ),. 

dm 3 600 4 667 6.300 12.889 15..800 12.667' 16.700 

( • «,( U ( 4.031) ( 7.134) ( 7.928) (10.294) ( 7.158) (11.106) 

36.600 42.000 45.500- 47.700 5 ■ » / ' w ' 1 

'12,267) (14.267) ( 8.805) (10.770) ( 9.879) (18.869) C' )<■ )• 

«.600 57.100 53.555 . 51.300, 51.111 43.000 3 . f • 

(16,500) (14.387) ( 8.748) (10.770) ( 9.879) (10.604) (■)(•' 

61.100 54.300 54.111 50.000 «.88 ' «• » I'Z' 

(28.621) (12.693) (13.251) (28.534) (18.496) ( . ) ) I -23 ) 

52 500 52 600' 47.111 56.300 52.555 48,400 k.iV ^ -^^ 

( 9 )( 7 ) (26.241) (26.499) (14.005) (12.946) (90,597) (2!..^*! 

66.900 48.300 38.888 2^.400 '45.333 . • ■ 

(27.408) ^31.906) (31.880) (2?.623) (15.668) (20.055) ( .6 ) ( • ) 

56 500 50 400 '50,222 4(1.900 50.111 54.800 50.666 52.900 

{ :5 Im (13.581) im i 9.816) (13.910) ( 6.873) ( . ) 

6 900 53 400 49.555 48.400 49.888 49.300 50.222 52.300 

(12!l60) ( 6.736) (10.736) (14.206) ( 7.540) (10.842) ( 7.774) ( 7.181) • 

mai 1 = "IS. . -iter baseline Trial 3 = Second Sewter baseline 

. Trial 2 = First Seeester post module ■ Ttial 4 = Second Seiester, essons -1 

SeRICo . Trial 5 = Second Seiester, lessons 11-18 - Igg 
'—^"^ SR = success rate 



33% X 


5.100 8.000 


SD 


( 3.929) ( 7.930) 




15.300 11.600 




( 7.499) ( 4.881) 


44 


,400 2.000 




( .516) ( 2.789) 


45 


2.900 3.000 




( 6.757) ( 3.712) 


52 


' 4.400 2.300 




( '4.575) ( 1.163) 


Tot Mod 


29,500 27.800 




(14.370) (14.382) 


nthpr 


66.400 71.300 




(18.264) (14.407) 


SR 33 


48.400 46.900 




(38.728) (34.407) 


SR 34 


50.400 62.300 




(22.711) (19.916) 


SR 44 


30.000 30.900 




(48,304) (42.626) 


SR4S 


23.600 21.500 




(36.034) (28.344) 


SR 52 


43.100 40.900 




(39.413) (38.751) 


SR Tot Mod ' 


50.000 62.900 




(16.726) (17.514) 


SRAll-8 


48.100 55.300 




(12.096) (14.476) 



prompts generated decreased. Table 26 shows the results of a repeated measures 
ANOVA on tho total module prompts percent. Only trials are significant. Across 
the 33 lessons of the practicum analyzed in the year data file, there is a very sig- 
nificant (p< .001) effect of training and feedback on the Total Nfodule prompts ^jener- 
ated but no difference in the effectiveness of the two feedback conditions. 

Trial means for Total Module are shown in Part B of Table 26, Tukey tests on 
all possible pairwise comparisons resulted in significant differences (p < ,05) be- 
tween the following trials - Trials 1 and 3, 1 and 4, 1 and 5, 2 and 5, and 3 and 5, 
Thus, the baseline trial for first semester, Trial 1, is significantly lower than 
all 3 second semester trials. Trial 2, first semester, is significantly lower than^ 
Trial 5 only. For the :;,8cond semester trials, only Trial 3 i§i^significantly lower 
than Trial 5. Across the whole year, trainees more than doubled their use of Total 
Module prompts, from 28,7% to 59,2%. Increases across the year were significant only 
between trials two trials apart, showing the necessity of continued practice before 
changes in performance occur, 

A multivariate analysis of variance was computed on 6 dependent variables - the 
five separate module prompts and ••Other." The results are shown in. Table 27, Only 
'Trials'' is significant. Therefore, treatments were equally effective in influencing 
trainee generation of the five separate vriodule prompts and "Other," 

Univariate analysis summaries for these six variables are shown in Table 28, 
Groups is not significant for any variable. Again, the two feedback conditions were 
equally effective. For the interaction term, one variable, the percentage of "45" 
prompts, is almost significant (p < .058), For the interaction terra, no other vari- 
ables approach significance. A look at the cell means for '^45" prompts in Table 25 
reveals similar percents for "45" for t^e two feedback groups at Trials 1, 3, and 4, 
However, at Trial 2, the Audio group generated more "45" prompts than the CATTS group, 
6,4 as compared to 2,0%, At Trial 5, the CATTS group generated^ jnpr^_"45" prompts 
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Table 26 

Repeated Measures ANOVA on Total Module Prompts 
for Five Collapsed Trials, Year Data (A.) 



Source SS df MS F p < 
Between Subjects 

Group 4.087 1 4.087 .001 .919 

(error) SWG 6876.718 18 382.040 

Within Subjects 

Trials 9182.085 4 2295.521 14.025 .001 

GT 585.616 4 146.404 .894 ,472 

(residual) Error 11293.791 69 163.678 



Means (and Standard Deviations) (B) 



Trial 1 Trial 2 Trial 3 Trial 4 Trial 5 

X 28.650 39.300 46.684 49.315 59.157 

SD (14.019) (13.243) (9.678) (14.944) (12.451) 
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Table 27 



Source 



Repeated Measures MANOVA on "33", "34", "44", 
"45", "52", and "Other" Prompts for Five Collapsed 
Trials, Year Data (First Roots Only Reported) 



df, 



hyp 



df. 



error 



P< 



R (Canonical) 



Groups 
Trials 
GT 



.222 
4.906 
1.300 



6 

24 
24 



13 
224.479 
224.479 



.962 
.001 

, 165 



.305 
.821 
.494 



Table 28 

Summary of Repeated Measures ANOVA's ot^H] 
"34'», »»44", '»45'\ ^'52^' and '»Other** Prompts for Five Collapsed 

Trials, Year Data (A) 



Source 



Variable 



F (df) 



MS 



P< 



Group 



Trial 



GT 





[1,183 








n n n 
. UUU 




• ^OD 




r\ r\ r\ 

. UU9 


1 . oU^ 


Q9 ^ 


44 


.040 


1.448 


.843 


4S 


.169 


7.646 


.686 


52 


.280 


31.536 


.603 


Other 


.071 


25.924 


.793 




(4.69) 






33 


7.150 


259.757 


".001 


34 


1.913 


70.821 


.118 


44 


7.469 


84.444 


.001 


45 


3.623 


49.194 


.010 


52 


22.434 


633.012 


.001 


Other 


19.311 


2437.406 


.001 




(4.69) 






33 


1.138 


41.352 


.346 


34 


1.188 


43.980 


.324 


44 


1.403 


15.863 


.242 


45 


2.404 


32.649 


.058 


52 


1.077 


30.400 


.374 


Other 


1.255 


158.445 


.296 



Fi: 



'eans (and Standard 
t Semester 



Deviations) (B) 

Second Semester 



Variable 


Trial i 


Trial 2 


Trial 3 


Trial 4 


Trial 5 


(No FB) 


(No FB) 


(No FB) 


(FB) . 


(FB) 


33 


6.55 


11.250 


14.947 


12.894 


15.684 




( 6.27 ) 


(8.018) 


( 6.159) 


( 6.036) 


( 4.738) 


44 


1.200 


3.550 


3.368 


4.947 


6.842 




( 2.117) 


( 4.358) 


( 2.966) 


( 4.812) 


( 5.091) 


45 


2.950 


4.200 


4.000 


5.78S 


7.000 




( 5.306) 


( 4.862) 


( 4.150) 


C 4.076) 


(4.000) 


52 


3.350 


3.850 


5.526 


14.421 


14.789 




(3.645) 


( 2.978) 


( 5.777) 


( 9.118) 


( 9.419) 


Other 


68.850 


59. 350 


S2.368 


46.842 


39.894 




(16.206) 


(15.242) 


( 9.662) 


(10.812) 


(12.427) 
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than the Audio group, 8.4 as compared to 5.7%. This result suggests that CATl'S feed- 
back was more effective in assisting trainees to generate "45" prompts. 

For the Trials source of variance all dependent variables, except for variable 
"34," are significant. T:\key tests were run on all possible pairwise comparisons of 
trials. The following comparisons were significant (p < .05) for variable "33": 
Trials 1 snd 3, 1 and 4, and 1 and 5. Therefore, subjects significantly increased 
the percent of "33" prompts from 7% at Trial 1 to 15% at Trial 3, and maintained this 
level. Since feedback occurred during Trials 4 and there appears to have been no 
effect of feedback for the year data analysis on "33" prompts generated.. 

For "44," comparisons between Trials 1 and 4, 1 and 5, 2 and 5, and 3 and 5 were 
significant (p < .05). Comparisons between Trials 1, 2, and 3 were not significantly 
different. In most cases, the two feedVfick trials. Trials 4 and 5, are significantly 
higher than the no feedback trials, showing the effectiveness of feedback in increasing 
this behavior, with no difference between the 2 conditions of feedback. However, the 
mean percent of "44" prompts used (7%) is still far below criterion (15%) at Trial 5. 

For "45" prompts, only the comparison between Trials 1 and 5 was significant 
(p <C .05). This represented an increase from 3% to 7%, showing that trainees had the 
most difficulty in generating "45" prompts. 

For "52" prompts, the comparisons between Trials 1 and 4, 1 and 5, 2 and 4, 2 and 
5, 3 and 4, and 3 and 5 were significant. This prompt shows the most number of signifi- 
cant increases across trials (from 3% at Trial 1 to 1S% at Trial 5), showing that 
the emphasis on generating "52" prompts in the training was successful in changing 
trainee behavior. 

For "Other" prompts, the comparisons between Trials 1 and 3, 1 and 4, 1 and 5, 
2 and 4, and 2 and 5 were significant. "Other" prompts therefore, as intended, consis- 
tently decreased across trials, with the first semester trials (1 and 2) being sig- 
nificantly higher than the second semester trials of 3, 4, and 5. "Other" decreased 

o . 1 7: 
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from 69* at Trial 1 to 40% at Trial 5. 

In terms of trainee ability to generate the targeted behaviors, the 5 module 
prompts, the above results taken as a whole, suggest equivalent effectiveness of the 
two feedback conditions, and of the first semester Draining. Only for one variable, 
**45,'* did a group by trial interaction appear. For this behavior, CATTS appeared to 
be more effective in changing trainee behavior. 

The next set of performances of interest were trainee ability to modulate 
the targeted behaviors and select ones most appropriate in the given context such 
that the following pupil answer would be correct. The success rates of the prompts 
was the measure of appropriateness of modulation. The means and standard deviations 
on the success rates for the separate module prompts, total module, and total of all 
prompts (minus "8»»s) are shown also in Table 25. For each separate variable, there 
appears to be very little change across trials and, also, little difference between 
groups. For total module success rate, however, differences do appear. Table 29 
shows the results of a repeated measures ANOVA on the success rate of the total mod- 
ule prompts. Neither groups nor trials is significant, but the interaction term is 
significant. Trainees as a whole, therefore, did not improve their total module suc- 
cess rate over time, nor was there any difference between the two feedback conditions 
as a main effect. 

At Trial 1, the Audio subjects were about 13% higher than CATTS, 7% lower at 
Trial 2, 5% lower at Trial 3, 5% higher at Trial 4, and 2% higher at Trial 5. Large 
fluctuations occurred across Trials 1, 2, and 3 in total ipodule success rate for both ^ 
groups, with a decrease in success rate occurring as the trainees began to attempt to 
generate all 5 module prompts, a- t Trial 3. It appears that, as trainees increased 
theirl repertoire of prompting behaviors > they were initially not successful in choosing 
appropriate prompts. For Trials 4 and 5, the feedback on generation of prompts trials, 
there is almost no change at all in the iiuccess rate of CATTS trainees for total module. 

- 172 
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Table 29 

Repeated Measures ANOVA on Success Rate of 
Tot?l Module Prompts for Five Collapsed Trials, 

Year Data 



Source SS df MS F p< 



Between Subject!' 

Group 71.407 1 71.407 .215 .649 

SWG 5989.230 IB 332.735 

Within Subjects 

Trials 836.587 4 209.147 1.737 .152 

1208.638 4 302.159 2.509 .050 

Error 8308.614 69 120.415 
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However, Audio trainees increased their success rate from 44.9% at Trial 3, to 54.8% 
at Trial 4, and maintained approximately this level at Trial 5. In summary, for 
this dependent variable. Audio feedback appears to be more effective. 

A repeated measures MANOVA on the success rate of the five separate module prompts 
is shown in Table 30. 'Trials** is significant (p < .002), showing that success rates 
of individual prompts did significantly improve across trials, regardless of feed- 
back conditions. In Table 31, a summary of the repeated measures ANOVA's on the 
five module prompts is shown. Again, 'Trial** is significant, but for only three of 
the prompts - **44," **45,'* and **52/* Part B of Table 31 shows trial means and stan- 
dard deviations for these three variables. Tukey tests on all possible pairwise 
comparisons between trials were computed.. For "44," the following comparisons were ' 
significant (p < .05) - Trials 1 and 4, 3 and 4, and 3 and^S. Once treatment was 
administered (at Trials 4 and 5) subjects almost doubled the "44*' success rate from 
the levels at Trials 1, 2, and 3 (30% to 60% approximately), showing a large training 
effect. For **45'* prompts, the comparisons between Trials 1 and 3 and 1 and 4 were 
significant (p < .05). Success rate almost doubled across these trials. For "52" 
pronspts, the following comparison was significant - Trial 2 versus Trial 3. At Trial 
3, the baseline trial for second semester (which was preceded by a six-week vacatio. 
from tutoring) the success rate of **52" is significantly lower than the other trials. 
After feedback began, subjects increased the "52" success rate to the level for Tri- 
als 1 and 2. The practicum as a whole, therefore, did have a:! effect on trainee 
ability to modulate behavior but the two feedback conditions were equal in their 
effectiveness. 

The success rate of all prompts, minus **8"s or telling , was also analyzed. This 
is shown in Table 3?. No source of variance is significant; therefore ^ subjects 
maintained the same success rate level over all prompts throughout the year, 

o ■ . 
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Table 30 

Repeated Measures MANOVA on Success Rates 
of "33", "34", "44". "45", and "52" for Five Collapsed Trials. 
Year Data (First Roots Only Reported) 



P dfj^yp dfg„Q^ p< R (Canonical) 

Groups .531 5 14 .749 .399 

Trials 2.254 20 216.530 .002 .525 

GT .961 20 216.530 .422 .511 



Table 31 





Sunr.ary of Repeated Measures 


AN0'''A'3 or Success 




I) O t* A C 

Ka L 6 S 


or , , 


, 4i> , ano 


"52" for Five Collapsed 






i r3 n is , Year 






Source 


V ar I aD i e 


h [M) 


. 

c 




uroup 












JO 


nor 

.085 


74 .976 


. 7 74 






, 303 


296 .211 


. 589 




44 


. 120 


126.024 


. 733 




4 b 


.441 


666.198 


.515 






1 .919 


1662.625 


. 183 


Trial 




(4,69) 








:3 


1.324 


570.493 


.270 




34 


.635 


762.847 


.639 




44 


4. 116 


4772.936 


.005 




45 


2.459 


1543.346 


.053 




52 


2.623 


1928.654 


.042 


GT 




(4.69) 








33 


.208 


89.725 


.953 




34 


1.434 , 


1722.360 


.232 




44 


.921 


1067.774 


.457 




45 


1 .703 


1068.839 


.159 




52 


.484 


355.825 


.747 



Means (and Standard Deviations) (B) 



Vai j able 


Trial I 


Trial 2 


Trial 3 


Trial 4 


Trial 5 


44 


30.450 


37.000 


28.894 


61.368 


59.210 




(44.341) 


(34.810) 


(31 .465) 


(26.502) 


(.''.6.260) 


45 


22.550 


33.150 


42.052 


45.368 


58.578 




(31.5 71) 


(28.934) 


(32.125) 


(26.779) 


(23.097) 


52 


4:. 000 


57.600 


30.736 


46.052 


50.473 




(38.058) 


(30.481) 


(27.762) 


(17.627) 


(16.187) 
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Table 32 

Repeated Measures ANOVA on Success Rate 
of All Prompts (Minus S's) for Five Collapsed 
Trials, Year Data 



Source 


SS 


df 


MS 


F ■■ " 




Between Subjects 












Group 


16.652 


1 


16.652 


.066 


.800 


SWG 


4529.507 


18 


251.639 






Within Subjects 












Trial 


463.838 


4 


115.960 


1.425 


.235 


GT 


332.215 


4 


83.054 


1.021 


.403 


Error 


5614.747 


69 


81 .373 
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Accuracy of Completing Feedback Evaluation Sheets 

All trainees, regardless of tht feedback received, completed Feedback Evalua- 
tion Sheets (FES) on every lesson after Lesson 4 for the duration of the study, (See 
Figure 3 for a copy of FES used for Lessons 5 to 17,) It was predicted that subjects 
receiving CATTS feedback would be in 100% agreement when the data on their FES's 
was compared to the data on the printout sheets from the computer, since CATTS train- 
ees were simply to copy information from these printouts onto the FES, It was pre- 
dicted that Audio subjects, who had to code their own tapes and then complete the 
FES from their codings, would not bo as accurate, but would inqjrove as the study 
progressed. 

Difference scores were computed on eight variables from OROS that appeared on 
the FES's - »'2r' miscues prompted, "22" miscues prompted, "33," "34," "44," '^45," 
1152 If ''total module," and "Other'* (the non-module prompts in OROS categories 3, 4^ 
and 5), The tutor's computed percentage for each v^iriable was then subtracted from 
the percentage on the compute!* printout, resulting in a negative score if the tutor's 
estimate was higher than the computer sheet and a positive score if it W;<s lower. 
Individual difference scores are shown in Table 33 for Lessons 5 and 15, the first 
lesson of feedback and tenth lesson of feedback, respectively. It is obvious that 
CATTS tutors were highly accurate, with the exception of a few minor clerical errors, 
since al^iost all difference scores are zero at both lessons. Audio tutors are very 
consistently inaccurate ; with improvements being shov;n for Lesson IS for some tutors. 
For the percent total module, in considering the absolute difference scores of the 8 
trainees with data available at both lessons, three Audio tutors lowered their differ 
ence scores, four incrsa^jed them^ and one remained within one p^oint. (Tutors 10 and 
19 are omitted froin this tally.) Less than half of the Audio tutors, therefore, in- 
creased their accuracy of coding their own tapes. 

For the eight audio tutors with completed FES's for Lessons 5, 10, and IS, an 
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Table 33 



Individual Difference Scores (Computer-Tutor) on 
Feedback Evaluation Sheet for Lessons 5 and 15 



Tutor Group 



Lesson 5 



Lesson 15 



1 
2 
3 
4 
S 
6 
7 
8 
>9 
10 
11 
12 
13 
14 
15 
16 
17 
Ig 
19 



C 

C 

C 

C 

C 

C 

C 

C 

C 

A 

A 

A 

A 

A 

A 

A 

A 

A 

A 



0 
0 
0 
0 
+5 
-1 
-1 
-1 
0 



21 Z2 ii 34 44 45~^?- 



0 
0 
0 
0 
+ 1 
0 
0 
0 
0 



0 
0 
0 
0 
0 
0 
0 
0 
0 



0 
0 
0 
0 
0 
0 
0 
0 
0 

NA, NA NA 
-30 +28 +27 
+17 +40 +15 -17 
-17 -34 -18-6 0 +15 -10 
-25 0-9 -25 +10-1-2 
-14 -20+15-8-2-3 0 
+23+33+5-2 0+1-2 
-47-8 0-10-7+4+3 
0-67 0+7 0+2+16 
-19+40-1+1-9 0 -18 



0 
0 
0 
0 
0 
0 
0 
0 
0 
NA 
-16 



0 
0 
0 
0 
0 
0 
0 
0 
0 

NA 
0 

-16 



NA NA 
0 +2 
-4 -31 



Total Other 



0 
0 
0 
0 
0 
0 
0 
0 
0 
NA 
+ 13 
-52 
-19 
-27 
+ 8 
+ 2 
-10 
+25 
+ 9 



0 
0 
0 
0 
-9 
0 
0 
0 
0 
NA 
-22 
+ 3 

- 2 
+ 3 
-11 
+ 7 

- 3 
+ 2 
-17 



21 22 33 34 44 45 52 Total Oth.-T 



0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


-1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


- 0 


_ 1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


-1 


0 


0 


0 


0 


0 


0 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


-1 


0 


0 


0 


0 


0 


0 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


-3 


+25 


-5 


-19 


0 


0 


0 


0 


+20 


-12 


+ 8 


+8 


+18 


-14 


+20 


+59 


- 4 


+ 5 


-10 


-10 


-19 


-15 


0 


- 6 


+ 10 


- 4 


- 4 


-14 


-27 


+28 


+ 15 


- 1 


- 5 


0 


-11 


- 9 


+20 


+ 1 


+ 1 


+ 2 


+10 


-16 


0+100 


+ 9 


+ 9 


+ 19 


+ 1 


-14 


-59 


-15 


+10 


+ 10 


-16 


0 


-25 


NA 


NA 


■ NA 


NA 


NA 


NA 


NA 



0 
0 
0 

0- 

0 
0 
0 
NA 
0 

NA- 
-24 
+ 5 
-38 
+64 

- 2 

- 3 
+ 24 
-21 

NA 



0 
0 
0 

9- 

0 
0 
-7 
NA 
0 
NA ■ 
-3 
+5 
+20 
+ 10 
+11 
+ 4 
0 

- 2 
NA 
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average 'iifference seore (ignoring the sign) over the nine variables was taken at 
each trial and then averaged across the eight tutors- These mean difference scores 
were 12, 13, and 13 for Lessons 5, 10, and IS, respectively, showing no improvement 
in completinf^ FES*s for Audio tutors. 

It can be conf:luded that CATTS tutors were more accurate in completing FES's» 
It is hard to explain the lack of iniprovement_for Audio tutors, given the fact taat 
_jKitli--gw«p5-4:mrre^^ (in generating prompts) over trials during the stud/.. 

If the Audio tutors had not known the OROS codes, they would not have been able to 
increase their generation of module prompts snd decrease ''Other," as the performance 
data shows. The FES's were completed by subject; as a homework assignment; therefore, 
the time involved in completing them by tutors and tutor concentration were not con- 
trolled. Another possibility is that low frequencies per individual category on an 
individual lesson caused the percentage to be quite different if only one code was 
missed. Total module prompts, though, had a frequency of approximately 20 for each 
tutor at Lesson 15, so this explanation is not very likely. 
Attitude Towards Feedback 

All tutors received an ev:=iXaation sheet asking about their attitude towards 
feedback after Lessor- 17 and at the end of the study. (See Appendix for a copy of . 
the forms used.) Since ail trainees received botL feedback conditions, conqjarisons 
can be made between the tutors' attitude to^vard the two kinds of feedback. It must 
be noted that those tutors receiving CATTS feedback between Lessons 5-17, received 
CATTS for only four lessons. The comparisons, therefore, are not based on equivalent 
length of experience with the feedbfxk types. The results discussed bslow are from 
the evaluation sheets completed by all 19 tutors at the end of the practicum. 

Question 1 asked the trainees if they were satisfied with their presen t feed- 
back. Nine tutors who received CATTS during Lessons 18-21 said yes and one sdid no. 
For tutors receiving Audio feedback for Lessons 18-21, four said no and five said yes. 
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CATTS tutors tended to question the coders' accuracy in recognizing OROS behaviors, 
while Audio tutors questioned their own accuracy of coding. 90% of the tutors who 
received Audio and then CATTS for Lessons 18-21 were satisfied with the CATTS feed- 
back, while only S6% of those who received CATTS and then Audio, were satisfied 
with the Audio feedback. Accuracy of coding was a concern of both groups. As 
Measured by this question, tutors had a much more positive attitude to CATTS feedback, 

Question 2 asked tutors to describe the characteristics of their current feed- 
back that were the most helpful for them in increasing their ability to prompt, and 
prompt successfully. Tutors receiving CATTS for Lessons 18-21 mentioned the follow- 
ing - percentages of prompts and success rates, and the actual specification of 
interaction sequences (5 tutors) ; the visual display giving instantaneous feedback 
(3). One tutor receiving CATTS did not name any characteristic of CATTS as being 
most helpful, but said she believed Audio was more helpful because what was actu- 
ally said during the lesson could be heard as the coding of the tape was completed. 
Tutors receiving Audio feedback mentioned the following characteristics as most 
helpful - actual behaviors could be heard (6 tutors); one simply said Audio, was 
best and didn't specify any characteristic; and one tutor's comment was uninter- 
pretable. The characteristics of CATTS considere. to be most helpful by tutors 
vfere the detailed codes for behavior, and immediacy of information. The most milpful 
characteristic of Audio was the ability of tutors to actually hear the interactions 
during the lessens. 

Question 3 asked tutors to describe the advantages and disadvantages of their 
current feedback. Tutors receiving CATTS feedback for Lessons 18-21 stated the 
following as advantages - quick and easy (3 tutors); immediacy of feedback (2 tutoks) ■ 
and stated the following as disadvantages - CATTS encouraged just looking at numbers 
and transposing them (1); "the video display didn't always show what prompts 1 gave" 
(2); and "I couldn't listen to what actually happened in the lesson" (3). Tutors 
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receivirkg Audio feedback for Lessons 18-21 said the following were advantages - 
'•i^ helps rae to know (listen) to what the pupil and I are actually doing so that I 
can figure out putts'' (6) - and said the following were disadvantages - the length 
of time involved (4); and the lack of accuracy and immediacy of audio feedback (2). 
One tutor receiving CATTS for Lessons 18-21 said it was not as helpful as Audio, 
and one receiving Audio for Lessons 18-21 said she had found CATTS to be of little 
help. The quickness of CATTS, therefore, was seen as an advantage^ while not being 
able to listen to the lesson was considered a disadvantage, causing tutors to feel, 
as one expressed it, "like a Xerox" copying numbers. 

The fourth question asked tutors which feedback they preferred and why (two 
tutoi3 did uot answer this question). Six tutors, 35%, said they liked CATTS best 
because of its immediacy, ease, and exactness; four tutors, 23%, said they liked 
Audio best because they could listen to themselves and see exactly what was happen- 
ing; and seven tutors, 42%, said that both should be a part of feedback, with an 
audio tape accompanying, say, every third lesson. More tutors, therefore, preferred 
to have both Audio and CATTS feedback. 

The attitudinal data, taken as a whole, suggests that tutors would have been 
more satisfied with the feedback if they had received feedback that consisted of a 
combination of both CATTS and Audio. Such a ''combination" feedb^ick would combine 
the ease, immediacy, and coding details of CATTS with the opportunity to listen to 
the actual behaviors of the lessons; characteristics seen as most helpful for CATTS 
and Audio characteristics, respectively. While a slightly higher percent of tutors 
preferred CATTS over Audio feedback than those preferring Audio ovcr CATTS, C""TTS 
feedback did not produce a more positive attitude toward feedback, as predicted; 
M combination feedback was preferred by the highest percent of tutors. 
Discussion 

The puri)Ose of the study was to compare feedback using a Computer-Assisted 
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Teacher Training System (CATTS) with the most similar feedback that a teacher train- ' 
ing institution (pre-service or inservice) without computer support could imple- 
nent. The comparison feedback (Audio) involved subjects coding their own lessons 
while listening to an Audio tape. The general conclusion, based upon the study here- 
in, is that CATTS and Audio feedback are equally effective in training pre-service 
subjects to generate and modulate their behavior during oral reading strategy les- 
sons. Tutors' analyses of their own behaviors, as completed on the Feedback Evalu- 
ation sheets, are more accurate for CATTS feedback. The results of the attitude 
measures revealed that tutors would prefer to have both kinds of feedback (CATTS 
combined with Audio) instead of the single feedback condition. 

Because this study contrasting CATTS and Audio feedback was part of a training 
practicua and not jiist an experimental research program, highly controlled proce- 
dures could not always be maintained. Much effort was expended by the experimenters 
to train the practicura participants in al' i>hases of teaching reading to the mildly 
handicapped. (No outcome measures, however, were collectcjd in other areas.) In 
addition, there was wide variance in pupil achievement, with pupils ranging at the ' - 
start of the practicura from non-readers to a reading level of 3.6, although the mean read- 
ing levels for the pupils assigned to tutors in the two experimental groups was 
approximately equal . 

Since a major goal of the program was to train tutors in the generation and 
modulation of module prompts, several changes were made in the procedui-es as ini- 
tially planned. The initial plan for the second semester was for trs-nees to receive 
feedback on generating all 5 module prompts for Lessons S-17 and then to receive 
feedback on success rate for Lessons 18-21. It quickly became clear to the experi- 
menters, however, that, even with the first semester training and the discrimination 
training of second semester, trainees were having ?. great ieal of diff:.culty in gener- 
ating all 5 prompts. For that reason, proceriures were changed so that j.ach lesson 
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had a single prompt as a focus. After the focus changed to another prompt, train- 
ees were to continue practicing previously focused prompts. The total possible 
lessons in which each prompt was practiced were - 12 lessons for '*52" prompts, 6 
for "45," 4 for "33," and 2 for "44." Wliile trainees were permitted to use other 
than the focus prompt if a pupil miscue called for it, the results of the analyses 
reflect this differential emphasis on prompts. The prompt that was practiced the 
least, "44," had the lowest percent (7%) at Trial 4. However, "33" prompts were 
practiced only 4 lessons but had the highest mean percent at Trial 4, 20%, "45" 
prompts, practiced 6 times, had a mean percent of 9%. The prompt practiced the most, 
"52," had a mean of 15%. Some prompts appear much more difficult to learn than 
others, or, possibly, are too restricted in terms of the te;.*: characteristics for 
which they are appropria':e. 

A related issue is the unequal number of lessons per trial. The changes above 
necessitated that lessons be collapsed into trials such that Trial 1 had 4 lessons; 
Trial 2, 6; Trial 3, 7; and Trial 4, 4. There is probably little effect of the 
bs5eline trial being unequal. But the number of lessons in which success rats? feed- 
back occurred was probably too short to test the relative effectiveness of CATTS and 
Audio feedback in increasing success rato. 

The performance data suggests that training and feedback is more potent when 
the targeted behaviors are already part of the subject's repertoire. Borg (1972) 
had difficulty in training teachers to emic behaviors not already a part of their 
repertoire. Three targeted behaviors, "44," "45," and "52," were not a part of train- 
ees' repertoire at all at the stirt of the practicura. With the exception of "52," 
which was practiced a great many lessons, these prompts had the lowest mean' percent 
at the end of the study. 

PerfonT7>>nc€ data also suji^ests that it is much easier to train subjects to 
gen erate behaviors than to ttsLin them to rnodulate t^i-'^ Vehaviors, i.e., to genera»:fcf 
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contextually appropriate behaviors. For each target behavior (nodule pronpts)^ four 
increased in percent generated across trials while one ("34") decreased. The percent 
of total module prompts also significantly increased across trials. The success 
rate of each behavior was a proxy for its contextual appropriateness. Only three 
of the prompts significantly increased in success rate across trials - "33," "44," 
and "52" - while the total module success rate did not increase significantly. The 
success rates were also lower than anticipated at the end of training, with only 
approximately half of the prompts in each category being successful. Increasing 
the subjects' ability to generate the target behaviors had somf transfer to their 
ability to generate successful behaviors, but absolute levels of success rate re- 
mained low. It is possible that increasing the length of time in which feedback on 
success rate occurred, would have increased the success rate. This would probably 
result only if specific training in the use of appropriate contextual information 
was given. 

One of the problems of the study was the amount of content covered in the dis- 
crimination training. Tutors were trained in 31 categories of OROS, instead of in 
ju3t the 5 targeted module prompts. he amount of Information appears to have been 
too great, resultins; in tutors not attaining a mastery level in those codes on which 
feedback focused. For the five target ,)rompting behaviors, the mean discrimination 
score was 44%, the mean generation sc . for novel prompts was 58%, and for all 
prompts, 92%. These results show the difficulty tutors were having at the start of 
the feedback conditions in both discriminating and generating novel prompts, even at 
the end of the discrimination training. This difficuJi^r manifejted itself during 
the first few lessons of feedback. For that reason, two proup meetings were held to 
discuss definitions of the target behaviors, present exas.los, and havfl tutors prac- 
tice generating them. Since all tutors attended these meetings, all received t{iis 
discrimination and generation training. This training may have been the most potent 
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treatment factor, since h'agnex- (1973' found that, given nvotivation to change, dis- 
crimination training was sufficient for behavioral changes to occur. 

A characteristic of both feedback conditions was specificity, or focus. Feed- 
back thav is focused, i.e., that enables the subject to determine his/her departure 
from desired performance, is more likely to produce behavioral change (Fuller, 1973; 
Salomon 5 McDonald, 1970). The performance objectives for both grotqps were quite 
specific^and feedback related directly to those objectives. Focused feedback, there- 
fore, regardless of the method used (CATTS or Audio), appears to be effective in 
producing behavioral changes. 

Audio subjects received only an audio tape and were able to listen to the ac- 
tual teacher-pupil interactions occurring in their lessons. Simply playing an audio 
tape of a lesson with no specific focus would be very unlikely to produce perform- 
ance changes. However, in combination with extensive discrimination aiid generation 
training, as occurred here, taped feedback appeairs to be as potent as co '^^d numbers 
on a display or printout. Given the results of the attitude survey, it is quite 
possible that a combination of CATTS and Audio feedback would be more effective than 
either one alone. This would be an important research issue for future CATTS research 
projects to explore. 

Previous research using CATTS has shown that CATTS feedback is significantly 
more effective than no feedback or supervisory feedback (Schmitt, 1969; Van Every, 
1971), and that a combination of CATTS delayed and instantaneous feedback is more 
effective than delay^l alone (Semmel et al. & Sitko, 1976). The results of the pres- 
ent study, while noffrefinitive , suggest that CATTS is as effective as Audio feedback 
aila that the computer technology of CATTS., while having the advantages of speed and 
accuracy of feedback, is equivalent in ef fectivciicss with Audio feedback* Before 
final conclusions are drawn, however, replications in othrr subject areas with, for 
eximple, inservice teachers of the mildly handicapped, are needed. 
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5 . Effects of Traini ng en Teacher Dec! /.ion-Making 

The improvesenr of teacher e i'-^cat ion., and by extension, the improvement 
of teaching, is said to rest upcn * . an understanding of how teachers 
cognitively construct the reality of teaching and learning . . (Gage, 1975). 
In this view of teacher education, the enphas's is upon how teachers apprehend 
a given instructional situation and hov? they ^^pply decision rules as a pre- 
cursor of action. The current interest in do^f sion-making represents a shift 
from concern with observed teacher behavior to an emphasis upon determinants 
of that behavior. This path of inquiry in teacher education, in many ways 
parallels the study of cognition in the psychology of learning. As such, it 
is Subject to the same criticisms frequently leveled at cognitive psychology; 
i.e., motivations, attributions, and other internal states of the organism 
must be inferred from observed behavior or inferred from introspective reports 
of the subject- Validation of the-'^e inferred states must therefore, ultimately 
rest upon observable behaviors. 

The present study utilized the stimulated recall technique to obtain data 
on trainees' easons for a given teaching behavior. Levels of decision-making 
and/or rational processes underlying teaching were thereby inferred from these 
self-reports. The internal validity of self-reports depends upoT^ the accuracy 
of the trainees' recall* while the external validity of the inferred states rests 
upon observed behavior. Since the Present study of trainee decision-making was 
part of a larger teacher training, teacher behavior research project (Semmel, 
Brady, Semmel, 1976), teacher performance data was available for validation of 
the recall interviews. 
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Interactive decision-naking . The behavior of teachers in the interactive 
instructional exchange with pupils presumably involves a cctaplex level of 
information processing. At a nininun, the teacher must attend t^ multiple 
sources of stimuli (e.g., pupil lehaviors), discriminate amon^^ the various 
stimulus signals and then consider the response alternatives to the stimulus 
selected for response. To a large extent, the sources of stimuli in a class- 
room and trie ter^xhers* responses, are obsen/able phenomena. However, the 
processes assumed to intervene between these S-R units (i.e., signal detection, 
discrimination, stimulus selection, review of response alternatives, decision- 
niaking) can only be inferred. 

The processes involved in teacher decision-making have been the subject 
of much recent attention in the field of teacher education (Gage, 1975; 
Shavelson, 1976; Shalman ^ Elstein, J975; Semmel, 1975; Morrissey & Semmel, 
1975). Good teachers are said to ap-^ ' decision rules both proactively (plan- 
ning of instruction) and interactive , .^Imlman a Elstein, 1975; Marine, 1975; 
Intili, 1976). Salomon (1972/ and Morine (1975) have suggested that teacher 
education programs incorporate training in decision-making, rather than treat 
decision-making as an outcome of teaching. It is apparent that teacher decision 
making may be treated as either an indep *:^^udent or criterion variable. 

The diagnostic-prescriptive method of instruction is based upon a decision- 
making model, but it is addressed primarily to the proactive phase of teaching. 
The application of the model in interactive teaching however, involves the 
integration and application of the diagnostic-prescriptive decision elements 
in real-time. While decision making is said to be a rational, reflective 
process (Shulman & Elstein, 1975), teacher behavior based upon decision pro- . 
cesses must take place without the benefit of much time to reflect upon and 
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consider alternatives. This raises the question^ Can systematic aedir.trion 
in the form of decision making really take place during the interactive phase 
of instruction? 

If the behavior of teachers in th interactive mode involves complex 
goal directed internal processing, it Is important to define the limits of 
such processing. Can such decision-making be measured? Can we assume that 
inexperienced teachers, preservice trainees and "poor" teachers process at a 
minimal level with only rudimentary decision rules applied to a limited sub- ^ 
set of the available alternatives? Cast training interventions be expected to 
affect the processing which we assume o-^curs between the stimulus situation 
and the teacher's response? Several of these questions were aadressed within 
the framework of a competency-based coirputer assisted teacher training (CATTS) 
program, set in a controlled laboratory classroom. The behaviors studied were 
limited to those teacher/pupil int|eractions that occur during oral reading. 
The laboratory setting and the limitation of the observed ceacher/pupil be- 
haviors to oral reading, provided a high degree of control over conditions 
which normally vary in classroom research. 

Teacher trrlning and decisi on -making . The teacher behaviors of interest- 

r 

prompting behaviors, were the subject of a program of teacher training and 
feedback, designed to provide teachers with decision rules and skills in the 
use of prompts in oral reading. Thus, both stimulated recall interview data 
and observational data on trainee prompting behavior were obtained over a 
two semester period* 

The data were collected at speciilc time intervals which paralleled the 
termination of a given phase of the teacher training program. Interview and 
performance data were initially collected during the period when trainees first 
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began tutoring but had not yet received specific instructions on pronipting 
pupils' ora^ reading, nor ha^ hey received any feedback about their teaching 
per. cnance. The second interviews vere obtained after trainees completed an 
instructional nodule on strategies for prompting pupils oral reading muscues, 
but were not receiving any feedback cn their teaching performance. The third 
set of Interviews and performance data vere obtained during the second semester 
of tutoring. 3y this tiae, trainees had completed discrimination training on 
the Oral Reading Observation Systens, (Brady & Lynch, 1976) and had also been 
receiving either Computer Assisted Teacher Training Service (CATTS) or audio 
tape feedback ^n their t:eachiag performance. 

- iubjects . The subjects of the study were twenty junior year preservice 
trainees from the Indiana University Special Education teac'^-. education pro- 
gram, ^hey were participants in a tutorial teacher training practlcv ' desij^ed 
to develop trainee knowledge of and skills in prompting oral reading. Trainee 
interactive prompting skills were developed through several successive teacher 
trainlns; interventions including instructional module, discrimination training, 
CATTS (video display) feedback durlnp^ teaching, post-teaching CATTS feedback 
(computer printout summary) and audio tape replay of lessons. 

Each trainee was assigtied to tutor a pupil who had been referred for 

reading tutoring because of severe reading deficit. The pupils w^re from both 

regular and special education classes. Six of the tventy pupils in the program. 

« 

were replaced during the end of the first semester or ct the beginning of the 
second semest anse subsequent evaJ nation showed that their reading deficits 

were not as great ar. that indicated by the data accompanying the original re- 
ferral. The rest of t]\e pupils remained with the same tutor throughout the 
P'^oject. 
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Feedback groups. As a test of the effectiveness of CATTS real time feed- 
back in assisting trainees to generate appropriate oral reading prompting be- 
haviors, half of the trainees were assigned to a CATTS feedback group (n=9) 
and half the trainees were assigned to an audio tape feedback group (n«10) , 
during the second semester. There was no feedback provided to the trainees 
during the first semester of the program. The unequal n's in the two groups 
was due to the loss of one trainee during the second semester. 

The Stimulated Recall Interview , The procedure for collecting information 
about trainees' decision making was through a stimulated recall interview in 
which an audiotape of the trainees' previous oral reading lesson was played 
back to the trainee. The interviewer stopped the tape after each pupil miscue 
was heard and asked the trainee if he/she remembered the response (if any) 
given to the miscue. The trainee was then asked, "What was your reason/purpose 
in responding to the miscue?" Interviewers also probed the initial response 
with "Any other reason?" 

Classification of trainee ouZLaments , Two trained coders listened to 
the taped recall interviews and^ through a consensus procedure, classified the 
trainees responses to the interviewer's probes. A response classification 
system was used for this purpose and where possible, six miscue-probe se- 
quences were classified. (A sequence was initiated by a pupil miscue on the 
replay tape. An interviewer probe and trainee recall about his/her behavior 
in dealing with the miscue, constituted a sequence.) For the purposes of 
analysis, four of the six miscue/probe sequences were used. The four probes 
per interview that had the highest number of statements were selected for 
final scoring. The purpose .''or selecting only four probes for each interview 
was to reduce the variability that occurred within each interview. The protocols 
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of trainee responses to stimulated recall interviews were codified by means of a 
Recall Interview Classification System . Three main categories of trainee re- 
sponses in the classification system were; 1) Trainee focus on learner charac- 
teristics; 2) Trainee focus on instruction and text characteristics; and 3) 
Trainee restatements of behavior. Each of these three main statement classi- 
fications were in turn made up of related subcategories. 

The trainee focus on learner characteristics category was made up of 
statements that fell into the following four subcategories: 1) Statements on 
pupil cognitive or developmental state, including mention of pupil intellectual 
functioning, readiness, test data or generic reading skills. 2) Motivational- 
affective statements including views on the pupil* s attitude, anxiety, coopera- 
tion, resistance, etc. 3) State of pupils' knowledge or information, as a 
basis for prompting. 4) The attentional state of the learner at the time a 
prompting decision was made. 

The second major category of trainee responses to the stimulated recall 
interviews concerned statements about instruction , instructional goals or text 
characteristics . Subcategories of this classification were: 5) Statements 
about the use of context as a basis for prompting. 6) Graphic cues, i.e., 
commonalities or differences in written representation. 7) Phonemic cues; 
relevant auditory cues to decoding. 8) Generalized statements about instruc- 
tional goals and other text features such as pictoral cues. 

The third main category of the classification system, restatements of 
behavior, accounted for trainees retrospective statements which were a virtual 
reiteration of the actual behavioral interaction which had stimulated the recall 
response. While these statements showed no evidence that decision-making had 
taken place, the prevalence of such statements in response to interviewer probes 
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led to the conclusion that in some instances trainees were unable to interpret 
or explain their behavior even though they were given the opportunity to re- 
construct the interactional sequence of events. 

Data collection > Recall interviews were conducted three times over the 
course of the two-semester oral reading tutoring project. The first interview 
was conducted during the second week of the tutoring program. Trainees were 
thus at the beginning of their practicum and generally inexperienced. The 
second interview took place during the last week of November, 1975, Prior to 
being interviewed in November, all of the trainees had completed an Oral Reading 
Prompting Module, (Brady, 1975) which was an instructional unit on decision- 
making for prompting oral reading miscues and which provided guidelines fov* 
appropriate prompting behaviors. The trainees had been assigned to experimental 
an(i*control groups in order to test the effectiveness cf the Prompting Module. 
The experimental group completed the module a week to 10 days prior to the 
November interview, while the control group was interviewed within one to 
five days of completion of the prompting module. 

The final interview was conducted near the end of the second semester of 
the practicum. By this time, all trainees had at least 32 hours of tutoring 
experience and had been receiving CATTS or Audiotape Feedback on prompting 
behavior for about 12 lessons prior to the last Interview. 

Desi^ and Data Analysis . The study was conducted in an effort to deter- 
mine whether the stimulated recall interview provided a reasonable indicator 
of the parameters of trainee decision-making and "whf^the- the nature of trainee 
decision-making can be reliably inferred from tralnt- p^formance. Thus, in 
the first phase of the study,' a descriptive analy^zis j > irte results of the 
recall interview s conducted to determine the -^r jrr trainee responses to 
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the ir terview. In the second phase, data on trainees prompting performance, 
obtained fron the Oral Reading Observation System (ORGS), were analyzed by 
application of information and uncertainty statistics (Coombs, Dawes and 
Tversky, 1970), in order to raeasure changes in trainees' response uncertainty 
in the use of prompts at various stages of their training program, in the 
third phase, recall interview data were correlated with several indice-: of 
trainee behavior and with the response uncertainty coefficients, in order 
to determine the validity of the interview. 

Results of Stimilated Recall Interview . In order to obtain a representation 
of the decision variables reported by trainees to be the basis for their teaching 
behaviors, the frequency of trainee response to each decision category was con- 
verted to a percentage ol all responses to the Stimulated Recall Interview for 
each trainee. The percentages for all trainees (n-20) were reported for each 
trial as mean and standard deviation for each decision element. Tne mean and 
standard deviation of frequencies of response to each Recall Interview main class^ 
and subcategory (i.e., decision elements) for all trainees, are shown in Table 1. 
As can be seen from examination of class I totals, 60% of all responses to the 
first interview focused on some aspect of the state of the learner and about 
19Z of the responses focused on some aspect of text characteristicc and/or 
instruction (sum for class II) . The most frequently reported aspect of learner 
state reported by the trainees was "pupil previous knowledge of target word or 
pupil comprehension of text" (24%). The percentage for this subcategory re- 
mains at the same ] -^vel during the second interview, . -.'rt the total percentage 
for class I drops off scraewhat to 52%, and the cL-^s tote, percent (28%) in- 
creases in the seccy^et iz> '-^rv±e». The increase ov er tlie '^Tzut i/i'^-.i-^iew in the 
class II 1 aittrrlbuted to increae. 1 ve«RCflp^| •. "focus on 
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Table 1 

Mean Percentage Distributicn of Cecision Elements 
for Each Successive Recall I- "erview Showing 
Trainees' Reasons for Prompting 



Class I; Trainee Focus on 
State of Pupil 



Category 1. 

Category 2. 
Category 3. 
Category 4. 



Cognitive-generic 
state 

Motivational state 
Previous knowledge 
Attention-set 



Total for Focus on Pupil 



Class II; Trainee Focus on 
Instruction and/or Text 

Category' 5. Comprehension-context 
Category 6. Graphic cues 
Category 7. Phonic cues 
Categc i y 8. Other instructional 
Total for Focus on Instruction " 



Class in; Trainee Restatement 
of 8eha%'ior 

Category 9. Memory-recall 
Category 10. Visual-auditory 
Categorj' 11. Linguistic 
C ategory 12. Pictoral -other 



Firs t 
X SD 



Recall Inter.'iew 
Second 
X SU 



Third 
X SD 



13.45 (12.33) 12.99 

12.46 (11.95) 5.20 
24.04 (13.17) 24.42 

9.62 ( 8.87) 9.44 



(15.64) 
( 7.31) 
(13.19) 
( 9.52) 



59.56 (16.79) 52.05 (16.66) 



9.99 (14.35) 

5.10 ( 5.79) 

20.25 (12.75) 

6.20 (12.56) 

39.52 (24 ."05) 



7.15 ( 8.48) 13.10 (13.05) 35.88 (23.55) 

2.74 ( 4.93) 7.34 (12.56) 4.13 ( 8.06) 

5.29 ( 6.89) 2.86 ( 5.79) 2.55 ( 5.90) 

4. 04 ( :.46) 4.87 (12.56) 1.22 ( 3.36 



19.21 (10.34) 28.17 (25.21) 43T78 (29 



3.36) 
29.38) 



Total for Restatement of Behavior 



5.73 ( 9.25) 6.08 ( 9.40) 

12.22 (11.37) 10.73 ( 9.39) 
1.54 ( 3.98) 2.98 ( 5.97) 

1.74 ( 4.76) .00 ( .00) 

21.23 (13.41) 19.78 (14.61) 



3.20 ( 5.76) 
7.85 (12.83) 
4.75 ( 8.66) 
.89 ( 3.57) 
16.70 (22.807 
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context" and ''focus on graphic cues/' 

The third interview was conducted near the end of the second semester of 
tutoring, and the tutors shift from fccus on the pupil to focus on text and 
instruction, seen in the second intar^i^iew, continued (see figures 1-3). The 
percent of class III responses — restatement of behavior or methods einployed — 
remain fairly consistent over the three interviews • 
Performance as an Indicator of Trainee Decision-Making 

Trainee prompting behaviors were obseirved and coded for all lessons con- 
ducted over the two semester practicum* The OROS observation system was used 
to classify all pupil oral reading miscaes that occurred during an observation 
period and to classify the type of response (or non-response) given by the 
teacher- The pupil miscue/ teacher response dyads were analyzed with infor- 
mation statistics [Attneave, 1959; Coombs, Dawes & Tversky, 1970; Frlck, 1976) 
in order to ascertain the response taicertainty of trainee prompting behavior. 

Response uncertainty (information) statistics have been used as a measure 
of judgment or decision-making in a number of psychological studies amd in. 
previous studies of teacher decision-making (Salomon, 1970; 1968; i^eliamon & 
Sieber, 1970). Shavelson (1975) has suggested that informacion statistics may 
be a useful measure of teacher decision-making. 

The notion of respCT^e uncertainty and its relation to judgmieoc: oir niscision- 
making stemis frcnm. che iprca^bialistic nature of choices (or respon^uy^ i^. set 
of alternatives... Wlhen tte cinoices in a set of mutually exclusiv?^ cat^^oraes 
exhaustive of a glv- r iud Vf behavior (such as teacher prompt iuK'^ I- : /iror) 
are equally proba^rA cn^n nne uncertainty of response (or chc (: tmrlov^ 
category) is ^t^aiiJ .Mxlmal. In other words, if there were c -oi - of five 

response a. emat Lve« vaiiable and the frequency of choice of eacn -niative 
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was the sane for each alternative, the uncertainty voi.ld be at a maxinun (or 
equiprobable) • 

The basic infornation statistic H is used to describe the average un- 
certaiiit> of occurrences of categories in a classification (Fri* k, 1976). 
When H is zero, there is no uncertainty or in other words, total certainty. 
As H increases therefore, uncertainty increases. 

One limitation of H as a measure of decision-making is that it does not 
indicate which category in a class of responses accounts for the reduction of 
uncertainty in an array of response alternatives. However, once uncertainty 
coefficients are obtained, descriptive analysis of subcategory means and SDs 
may be applied to aid interpretation of the decision-raking measures obtained. 

The main argument for the use of information statistics as a measure of 
decision-making is that they can provide an indicator of whether trainae be- 
havior — in relation to a specific class of behaviors — is occurring at or near 
random (high uncertainty), or whether it is occurring with a high degree of 
predictability (low uncertainty). Thus, trainees whose prompting behavior 
bears no predictable relationship (highly uncertain) to the type of pupil 
miscue, are probably not applying any decision rules in their prompting be- 
havior. (Unless, or course, a random walk model is adopted consciously as a 
teaching strategy.) 

The analysis of response uncertainty * There were two measures of uncer- 
tainty used in the present study: The first measure was the relative reduction 

*A11 data were analyzed using a computer program for information statistics 
written by Ted Frick. T. Frick also served as a consultant ott this phase of 
the study and gave invaluable guidance in computation and interpretation. 
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of uncertainty for the joint classification of pupil niscue and teacher response 
categories. The statistic used in this case was T, which indicates the con- 
straint between the uncertainty of pupil behavior (i.e., meaning change (21) 
or no meaning change (22) miscues) upon the uncertainty of teacher prompting 
behaviors (i.e., no response, functional proiiq)t, dysfunctional prompt, feedback 
and telling) > The form of this analysis can be visualizec? as a two class 
matrix, with the pupil miscue class roade up of two mutually exclusive sub- 
categories and the teacher response class made up of five mutually exclusive ^ 
subcategories • The frequency of occurrence of each dyad for a given 
observation period is placed in the appropriate cell and converted to 
probabilities based upon marginal totals. 

T is calculated by: 

T(PM,TR) = H(PM) + H(TR) - H(PM,TR) 
where PM antecedent pupil miscue, and TR » subsequent teacher response. 

Where T is zero, there is no relation or constraint between the uncer- 
tainty of pupil miscues and the teachers* response. T is used to calculate 
the relative percent reduction of uncertainty (rT). rT provides an estimate 
of the relationship of the predictability of pupil behavior to 

subsequent teacher behavior. rT is defined as follows: 

rT(PM,TR) =» T(PM,TR) 
H(PM) 

The greater rT, the less uncertainty there is or conversely, the higher the 

rT the more certain the relationship between pupil miscues and teacher prompting 

behaviors. 

The second statistic used in the analysis was rH. This statistic was 
used to measure the percent reduction in uncertainty from maximum uncertainty 
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for a single classification. The "H" statistic — which is the basic statistic 

for all information uncertainty measures — vas first conputsd to determine the 

trainee.^* response uncertainty in the use of the five functional (nodule)* prompts. 

The formula for deterroining H is as follows: 
n 

H(MP) = - Zp (mp ) log p(ap,) 
1=1 ^ ^ ^ 

where MP is the class "Module Proinpts", "np" is a category of MP and p« proba- 
biiity of each category in the class. 

Where trainees use all five module prompts with about equal frequency 
the uncertainty of their behavior is high. Use of all five module prompts at 
about equal frequency was in fact the behavioral goal of the trainees during 
the second semester of the program. The program was partially based on a skill 
development model of teacher behavior in which trainees ability to generate 
given behaviors was seen as a necessary precursor of the ability to modulate 
these behaviors. In order to aid trainees in attaining skill in generating 
the module prompts, several forms of feedback were provided; real time CATTS 
feedback; delayed CATTS printout (post teaching) feedback; or audio tape (post 
teaching) . ''^ 

0 

Thus, in order to see if trainees provided with alternative forms of 
feedback on their prompting behaviors were able to succesjjfully achieve the 
behavioral goal of using all five module prompts, the relationship of the ob- 
tained H to maxitDum H was calculated. The formula for H max is: 

H log.»n 
max *2 



*The five "module" prompts were the focus of the teacher training program. 
Trainees worked on achieving facility in generating these prompts in responsp. 
to pupil miscues. The prompts (or cues) were:. 1) attention, 2) word in context 
(meaning cue), 3) structural (syllable cues). A) pattern (word family), 5) 
O Phonij: rule. . , , ^i}^ 
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where n « number of categories in the classJ.f ication. 

The formula for rH is: 

rH - ^max - H x ICO 
H 

max 

Results 

Relative response uncertainty . Table 2 shows the group means and standard 
deviations of rT coefficients obtained for all trainees in the study, rT was 
calculated for each trainee for three obseTrvation periods at different time 
intervals over two semesters of the program. Trial 1 was made up of observed 
frequer4cies of teacher-pupil behavior during tht first six lessons taught by 
trainees. Trial 2 was made up of two different observation periods for each 
of two gtoups that the trainees were placed in for the purpose of assessment 
of the effectiveness of the Prompting Module. Trial 2 for the experimental 
(E) group consisted of observation data from lessons 7 through 10. Trainees 
In the E group completed the Prompting Module after lesson 6 and thus the 
four lessons in trial '2 for the E group were taught with the knowledge of 
prompting behavior and decision-making that they obtained from the Module. 
Trial 2 for the control group cons^.sted of rwo post-module lessons, and were 
the 11 and 12th lessons taught tht first semester. The third trial was made 
up of observation data from the 17th and IBth lesson taught by all tutors near 
the end of the second semester of the program. By this time, trainees had 
undergone discrimination training on the ORGS and had 'been" receiving CATTS or 
audio feedback on their prompting behaviors. As can be seen in Table 2, the 
mean rT for all trainees prior to training on the use of prompts (trial 1) 
was about 22%. For the second trial, rT increased to 25.70% (SD 15.85) and 
showed a negligible increase in the third trial. 
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Table 2. Reduction of relative response uncertainty (rT)*, 
mean percentage and SD for all trainees. 



Observation 
Periods 



lessons 



Trial 1. Baseline 



1-6 



Trial 2. Post-instruc- 
tional module 7-12 

Trial 3. Post-feedback 
(second sem- 
ester) 17-18 



22.25 



rl 

SD 



(9.14) 



25.70 (15.85) 



26.37 (15.76) 



20 
20 

19 
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The small number of subjects in each group and the large SD obtained 
make any extended discussion of group differences in rT untenable. A repeated 
measures ANOVA performed for all trainees over thr^e trials was found to be 
non-aignif icant . 

From the perspective of rT as an indicator of trainee decision-making, 
the data did not show any significant changes in trainee decision-making over 
time or as a consequence of the treatment interventions (i.e., instructional 
module or feedback). This finding was obtained even though examination of 
the behavioral data did show significant changes in trainee responses to pupil 
behavior over time. This is shown in Tables 3 and 4. The pupil behaviors 
of interest were two mutually exclusive behavioral categories; meaning change 
miscues (21's) and no meaning change miscues (22's). The range of teacher 
responses to pupil raiscues as obtained from the ORGS was combined into five 
mutually exclusive teacher behavior categories. As shown in these tables, 
four out of five classes of teacher behaviors in response to 21 miscues changed 
significantly between the beginning and termination of the project, and one 
out of five classes of teacher behavior in response to 22 miscues showed sig- 
nificant change over the span of the program. 
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Table 3 

Percent Frequency (Means and SD) of Teacher Responses to Pupil Meaning 
Change (21) Miscues; Trial 1 (1st Semester) and Trial 3 (2nd Semester). 







Teachei 


r Behavior 


Trial 


No Response 


Module Prompt* 


Non Module Prompt* 


Feedback* 


Telling* 


1 


24.05 (15.60) 


25.49 (15.99) 


16.63 (11.33) 


15.48 (9.16) 


18.36 (17.15) 


3 


28.38 (12.51) 


47.61 (14.29) 


7.50 (6.79) 


10.08 (7.59) 


6.44 (7.59) 






p<.001 


p<.004 


p<.05 


p< .01 



. , Table 4 

Percent Frequency (Mean and SD) of Teacher Responses to Pupil No-Meaning 
Change (220 Miscues; Trial l"Tlst Semester) and Trial 3 (2nd Semester). 







Teacher Behavior 


Trial 


No Response 


Module Prompt 


Non Module Prompt 


Feedback 


Telling* 


1 


64.00 (20.12) 


11.98 (11.94) 


3.05 (4.76) 


12.03 (13.23) 


8.95 (9.60) 


3 


76.51 (26.85) 


9.41 (15.51) 


.81 (2.43) 


6.17 (10.07) 


1.83 (4.59) 



p<.006 



•Significance obtained from matched pairs T test 18df . 
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Thus, while the behavioral data showed changes In percent frequency in ^ 
trainees' use of the prompting alternatives, these changes were not reflected 
in the mean percent reduction of response uncertaintty '(rT) for trainees at 
the three observation periods examined. 

Response uncertainty in the use of five module ( ,ig^...^^ Qtial) prompts . 

The mean rH was obtained from individual xV- cj:7^^£ricients for all trainees 
in the study for each of the observation periods rials) described above. 

In this instance, the hypothesis regarding the uncertainty of trainee behavior 
was the reverae of what had been predicted for trainee behavior contingent 
upon pupil behavior. Since the goal set for the trainees by the training 
program was for them to use about 15% of each of the five functional (module) 
prompts, it was expected that if trainees approached this behavioral criterion 
it would be reflected in a lower percent reductioi| from maximum uncertainty. 

This is what appears to have occurred (Table; 5). During the first trial 
there was a mean 42.93% reduction of uncertainty (from maximum uncertainty) 
for all trainees, a smaller re4uction at the second trial, and a substantially 
smaller reduction of uncertainty at the third trial (20.22%). In this case, 
the smaller the percentage reduction of uncertainty, the more uncertain the . 
behavior, and in terms of the training objectives (use of module prompts) 
great uncertainty is what would be predicted if the training were effective. 
Trial 1 differences between the two trainee groups appear negligible. Trial-- 
2 differences were not tested becuase the groups received non-comparable treat 
- ments in this observation period. However, the difference between the CATTS 
and Audio Feedback groups mean rH coefficients wais considerable. A one-way 
analysis of variance showed group significance (F=«7.39,' D.F. 1/17, P<.01). 
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Table 5, Percent reduction of uncertainty in trainees' use of five 
functional prompting alternatives (rH)* 



First Semester Observation Periods 



Group 



All trainees 

E(6 lesson 
baseline) 

C(10 lesson 
baseline) 



Trial 1 (Baseline) 



.D. 



. J 42.93 24.14 
10 39.77 24.92 
10 46.10 24.24 



Trial 2 (Post Instructional Module) 



S 



39.20 :i.47 
26.2- 22.17 

42.2 1 21.50 



Second Semester Observation 



Trial 3 (Post-feedback) 





n 


X 


S.D. 


All trainees* 


19 


20.22 


U.44 


CATTS FB 


9 


13.76 


8.89 " .■ 


Audio FB 


10 


26. OS 


10.52 



*Tiie smaller v s percent reduction of uncertainty, the more uncertain the behavior i 
Thu*', whero t .certainty is great, Ss may be said to be generating all categories 
of behavior at about equal frequency (e.g. , the, use of each of five alternatives 
are equiprobable) . 

a. While the trainees in the program were the same for both semesters (with 
the loss of one trainee 2nd semester), the treatment subgroups into which 
they were placed vrere different each semester. 



[■ince rH means were found to be significantly different for the two 
feedback groups there was some evidence suggesting that feedback treatments 
affect trainee decision making. That is, the relatively small mean percent 
reductioi^ of uncertainty (rH « 13.79% SD 8.89) shown by the trainee group 
that received CATTS feedback indicates that the CAVTS FB group generated each 
of the five functional (module) prompts with about equal frequency. This 
approximates the goal of the training program in terms of these specific 
behaviors. Likewise, the relatively higher mean percentage reduction shown 
by the Audio Feedback group (rH =26.03%, SD 10.52) indicated a trend away 
from equiprobability in the generation of the 5 functional prompts. 

In order to clarify interpretation of this outcome, the distribution of 
behavioral data for the two feedback groups was examined. Table 6 shows 
means and SD's for percent frequency of use of each module prompt by each 
feedback group during the third trial (post feedback) observation period. 
Both means and variances for each module prompt category were , tested for 

^difference's between groups- 

A one-way ANOVA of mean percent frequency for each module prompt cate- 
gory obtained by each feedback group revealed no significant differences 
between groups in the third trial. However, when the percent of variance 
from the mean for edch group was analyzed by a one-way ANOVA, the variances 

t vere ^ound to be significant (F =« 6.68, d.f. 1/17, p<.02). 
The Relationship of the Recall Interview to Decision-Making 

In order to jiet ermine if there was a relationship between the Recall 
Interview responses and trainee decision-making behavior as indicated by rT 
and rH, a series of zero order correlations were obtained between the variables 
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Table 6 

Mean Percentage Use of Module Prompts by 
Cnirr-^^ arv;d AJDIO Feedback Groups, Third Trial 



Module Prompt Category 


Group N 


(33 J.' cturr . ■) Attention 


(44) Pattern 


(45) Phonic 


T)' Context 


Total 19 
CATTS FB 9 
AUDIO FB 10 


X SD^ 
21.64 (11.74^ 
21.3:; (11. BO', 
22. CJ (12.33, 


X SD 

1 30.26 (19.26) 
53.44 (13.84) 
27.40 (24.51) 


X SD^ 
10.00 (9.99) 
9.67 (9.00) 
10.30 (11.29) 


X ^ 
9.74 r:''i:) 
11.33 r6.40n 
8.30 • Wi 


1 T _SD 

>^ (17.42) 
1 (5.80) 
f 1..V J (23.42) 
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r:^ ^il, success rate, and the total Recall Interview score and percent in emch 
.vf :'tte Recall Interview summary categories; i.e.. (1) pupil focus, (2) instrruc- 
friiiraal focus, (3) restatement of behavior. 

The method of obtaining rT and rH coefficients from frequencies of tr.lnee 

I 

and pupil behavior (as measured bn the OROS) was previously describe;;, a -houjd 
vaaert: is ranch empirical validation ot these information statistics .i5 vr^,idi_^3 

' i<.ici:i:iou-iatfikinig (Coombs, Dawes and Tver sky, 1968), the smal^- ^ 'iSbet 
: .ib l^*!tr,tsi in zaxe present study precluded formal validation of '-^ rES-calU i^iterr- 
vi«i»r xfcnrsugh correlation with an external criterion. Given ixdlt.^^iwna 3)f 

the m^^'^ jer ot subjects of the study, only face-validity fo: --ecall iaater- 

view :iiay be asserted aftd the study of he relationship between the Recall inter- 
view and vT, rH, and trainee success rate was undertaken as a means of uncovering 
trends in the relationships. Table 7 reports the correlation coefficients be- 
tween the variables rT, rH, percentage of statements in each ot the threu Recall 
Interview classifications (pupil focus, instructional focus, xsstatements) , a 
total interview score (number of discrete trainee statements) , and success rates 
(the rate of correct pupil responses to teacher prompts) . 

Trial 1 correlations showed a significant negative correlation between 
iT and rH (p<.005). This would be expected since rT was low (22%) and rH was 
relatively high (42.93%). Both these relationships are in the expected direction 
in t eras of trainee decision making prior to training and feedback interven- 
tions. Trial 1 rT and rH coefficients provided evidence of relatively little 
trainee decision making. 
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Tab^e 7 

Correlation Coefficients fur Recall InLt: 
Categories , Success k/;. i e an' r ^ 



Var.r ibl e 
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r - ^ 
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.ii 1 .3 






rH 




.5573 


■t ■ . 
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\ 

■ - . 










19 




vSuccess Rate 


* _ 


.3484 




20 




■iOl) 
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Pupi2 Focus 




.0686 




14 




l.')4) 


ir 




{..izm 


■ 


rl 


Iv^astar^ieTit 




.2364 


(.208] 


14 


.05 1: L 


448) 


17 


Mlih 


( Am4) 




rH 


?testat©ment 




.0508 


(.4521 


14 


-.49-01 


U21) 


]7 


. 0<t37 


i . 43fiO 


16 


Success 11 


Total Int. 




.5924 


(.013) 


14. 




012) 


IS 


- . 14kiS 


(.29ftj] 




Success ^ 


Pupil Focus 


* 


.4147 


(.070) 


14 


.384. 


Od4) 


17 


*_ .4i;r79 


(.o4i:i 




Success 


Instruct . Focus 




.1908 


(.257) 


14 


^•.44B,!. 


0-7) 


17 


* .4I±67 


(.'0£i4}i l& 


Succms > 


Restatement 




.3724 


(.095) 


14 






17 


-.Ofr4lS 


(.406) 




)%piii Fcotus 


Instr . Focus 




.6024 • 


(.011) 


14 




'j0.1I) 


17 


•-.fir,' ' 


(.003) 




Piupil Fc 


Restatement 




.7882 


(.0011 


14 




l^Jl 


17 


- . 2:1-5 


(.213) 


16 


lastT:^:-'^^. F. 


Restatement 




.0164 


(.4781 


14 




C'l) 


17 


■'■ - . em - 


(.0(07) 


16 
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The variable 51 occejs.^ -^ra, which was :ri : percent of cit3rrect pupil response 
to any teacher prirmpt oxc^i?. '*8^* (telling), ..^rrelated with a number of the 
Recall Interview categories These coeffLc: : its should be interpreted with 
caution since the number ai rainees from^- interview data was obtained was 
smaller than the rocal numbt of subjects cae study. Success rate corre- 
lated negatively with the total interview v.>'Fe — the total score in effect 
measures trainee valytri^ My — the number of iiU^tircnt reasons given for re- 
sponding to a given nsiscuvn Trainees were r^^e to give as mmy reasons as 
they could think of for responcing to the gz-veu miscue the w«3y that they did. 
Thus the higher the score, tne more reasons given. 

The rT and rH coef f icienria showed a low (-.2204) negrit±-7e correlation 
in the second trial and no correlation in the third trial. Again, due to the 
reversal in the direction of percentage reduction of uncertainty for the two . 
measures, this is what would be expected. 

In the Second trial success rate and total interview score was also nega- 
tively correlated (r.-.5272 p<.01). In the third interview, success rate and 
total score did not correlate. 

Success rate also correlated with the pupil focus category percentage in 
the' first trial (r - .4147 p<.07), and also in the second trial (r - .3843 
p<.06) However, the correlation obtained in the third trial, while also in- 
significant (p<. 04) , showed a change in direction of the relationship to 
negative .4479, 
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Similarly, correlation coefficients obtained for Success rate and the 
instructional focus category showed a significant negative correlation between 
these variables during the first and second interviews and positive correlation 
at the third interview. The inter-correlation of the pupil focus and Instruc- 
tional focus categories with trainees' tendency toward reiteration of behavior 
(restatement category) was negative in 5 of 6 instances. 
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Discussion 

Recall Interviews > The purpose of the Stimulated Recall Interviews was 
to obtain information from trainees on the reasons for th^r own prompting 
behaviors. Based upon this introspective technique of data collection, we 
found that r.he inexperienced trainees initially emphasized pupil variables as 
the basis for their prompting behavior. At the first interview, which took 
place during the initial week of teaching, trainees explanations of their 
prompting behavior involved pupil variables three to one over explanations 
relating to instructional variables. The pupil focus variables reported to 
be of importance by the trainees were: 1) papils' previous knowledge (2A%) , 
2) cognitive level of pupil (13%), 3) motivational status of pupil (12%), 
and 4) current attetitional state of pupil (10%). The trends in pupil-related 
variables as explanations of teacher behavior obtained In the second and third 
interviews are shown in Figures 1 and 2. A decline in all pupil variables can 
be seen in thase figures, but the largest proportionate declim:) is seen In the 
pupil motivational state variable. It is possible to attribute these results 
to a reduction of the trainees* initial anxiety over acceptance by the pupil 
or a concomitant growth in confidence about rapport with the pupil over the 
extenda^^iine period of the tut oria l program. In either case, pupil motivation 
was seen as less important a factor in trainee behavior near the end of the 
program than it was at the outset. 

The most dramatic shift in trainees* explanation of their own behaviors 
comes in the concern over instructional variables (Figure 3). While explanations 

centering on text characteristics and other instructional tactics (categories 
6, 7, 8) remained at a consistent low. level, trainees markedly increastid the 
percentage of explanations focusing on comprehension and context cues during 
the second and third interviews'. This fiijdlng reflects the emphasis placed 
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upon these variables in the teacher training program. The influence of parti- 
cipation in the training program is seen in the increasing attention to context 
and comprehension as the underlying rationale for trainee behavior. This 
effect was noted by the interviewers who found that in two separate instances, 
trainees offered word context as an explanation for their prompting behavior 
when the sanq>le of teaching used as the basis for recall could not be objec- 
tively classified as an instance of contextual proii]4)ting. In other words, 
even where the trainees had not adequately developed appropriate discrimination 
skills that permitted them to distinguish an instance of a context prompt, the 
primacy of context prompts as the rational basis for decision making was already 
established. 

The finding that trainees responded to some interviewer probes by re- 
stating the prompting behavior may reflect the automatic nature of some teacher 

\ " 

responses to pupil behavior. Such responses may be Interpreted as evidence 
,ot an absence of a rational or decision-making basis of the teacher behavior. 
On the other hand, reiterative responses may be due to the interview method, 
in which all trainee statements were accepted without comment and a given inter- 
view sequence terminated after, two probec. No trainee statements including 
restatements of the behavior were rejected, nor were such statements treated 
any differently than i^ubstantive answers to probes. This was because we felt 
that the risk of post hoc rationalization was probably quite high, and "forcing" 
answers from trainees would only inflate the tendency toward such rational-^ 
ization. 

21: 
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It is probably the case that a good proportion of teacher-pupil inter- 
action takes place with little conscious mediation and. some of this may be 
reflected in the trainees reiteration of behavior in response to the interview. 
The small decline in the rate of reiterative responses from 21% in the first 
interview to 17% in the last one (see Figure 1) , may be due to trainee 
familiarization with the interview situation. 

Response uncertainty . The argument was raised elsewhere in this paper 
concerning the reduction of response uncertainty as an indicator of teacher 
; decision-^making. Briefly the reasoning was that if teacher behavior in re- 
lation to a specific class of behaviors occurs at or near random (high uncer- 
tainty) or with a high degree of predictability (low uncertainty), then teachers' 
use of decision rules to guide behavior may be assumed. 

A teacher training intervention can be viewed as a method of reducing 
trainee response uncertainty. Within a limited domain, the effect of training 
on teacher behavior should be predictable in terms of increases or decreases 
in response uncertainty. In the CATTS-OROS training program, trainees were 
taught to use a series of decision "rules to determine which prompts to give 
in response to pupils* oral reading miscues. The decision paradigm was as 
follows: 

1, Determine whether the pupil miscue changes the meaning of the word or sen- 
tence. 

2. If the miscue does not change the meaning — do not pron5)t. 

J, If the miscue charges the meaning of word or sentence — use. an appropriate 
prompt. 

There were a series of additional decision rules provided to the trainees 
which were designed t:o aid them in selecting the most appro >riate prompt to 

er|c - ^i^' 



use If prompting was indicated. There were five different prompts stipulated 
by the training program as potentially appropriate or functional. These five 
prompts were by no means exhaustive of all possible prompting responses and 
a major goal of the training program was to assist trainees in using the five 
functional prompts and to eliminate the use of the so-called dysfunctional 
prompts from their response repertoire. 

Given the decision making model which served as the basis for the CATTS- 
OROS teacher training program, the prediction that trainee prompting would be 
initially uncertain is warranted. That is, in the absence of explicit decision 
rules, consistent or rule governed prompting behavior would not be expected. 
Rather, a greater initial tendency toward trial and error prompting would be 
predicted. And the logical outcome of the hypothesized early trial and error 
prompting behavior would be the subsequent ohaping of teacher behavior through 
reinforcement in the form of pupil responses (e.g., success rate, tension 
reduction, etc.). Thus, the outcome of teacher-pupil interaction over time 
alone would be in the direction of lowered response uncertainty - the same 
prediction proposed as the outcome of a teacher training intervention. But 
while the direction of teacher behavior changes in both instances would be 
toward reduction of response uncertainty, only in the case of a training 
intervention could the categorical nature of the behavior change be predicted. 

The trend in the reduction of relative response uncertainty (Table 2) was 
in the direction predicted but the magnitude of the reduction was nonsignificant 
for the trainees as a total group. Thus, changes in trainee decision making 
behavior as measured by the reduction of relative response uncertainty was not 
borne out. However , evidence for change in trainee behavior as a function of 
participation in the training program was obtained and this reflected the 
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tenets of the program in a number of ways, Tables 3 and 4 show trainee behavior 
changes between the beginning and end of the program, an Interval of some 
six months. Significant increases in trainees' use of functional (module) 
prompts in response to 21 (meaning change) miscues as well as a decrease in 
the use of dysfunctional (non-module) prompts to 21 miscues were obtained. 

There were no significant changes in trainees' non-responses to either 
meaning change (21) or no meaning change (22) miscues between the beginning 
and end of the program. But trainee non- responses , to the two types of 
pupil miscues were at an appropriate relationship from the outset; there were 
nearly 2 1/2 times as many non- responses to no meaning change (22) miscues as to 
meaning change (21) miscues. While the centrality of the decision to prompt 
or not to prompt contingent upon whether the pupil miscue was 21 or 22 would 
lead us to expect an increase in nonresponses to 22 's and a decrease of 
nonresponses to 21' s, this did not occur. It is possible that some trainee 
non-responses reflect a failure to process the pupil behavior rather than a 
conscious decision not to prompt. 

The significance of the change in trainees use of feedback in response 
to pupils' 21 miscues cannot be easily interpreted as the training program 
was neutral on this behavior. The change in the "telling'* category was also 
difficult to interpret as trainees were instructed not to use telling as a 
response to 21 miscues but to give the correct word only when-the pupil failed 
to do so after being prompted twice. We cannot tell from the data as 
organized for this analysis whether the telling prompt occurred as an initial 
prompt or as a termination of a set of unseccessful prompts. 

Response uncertainty and teacher training . The trainees' use of the five 
functional prompts may be regarded as trainee decision-making in the sense > 

221 
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that the task of generating all five prompts required conscious selection 
among a fixed set of alternatives. However, these choices were conditioned 
by a behavioral goal requiring approximately equal use of all five prompts • 
This was a direct test of the effect of training and feedback upon trainee 
decision making. A small percentage reduction of response uncertainty would 
indicate the success of trainees in achieving the behavioral criterion of 
using all five functional prompts at the rate of about 15% each. That is, 
the stipulated behavioral criterion was equal use of the five prompts and re- 
« stated probabilistically, achievement of the criterion behavior would be 
indicated by maximally uncerta'in behavior. 

Table 5 shows that for the trainees as a whole, reduction of imcertainty 
decreased over time (trials), indicating greater uncertainty in the use of the 
five functional prompts after participation in the training program. 

During the second semester of the program, CATTS real time feedback was 
provided for half of the trainees in the group to aid them in generating the 
five functional prompts during teaching. The other half of the trainee group 
received a post-teaching audio tape of their lesson, a contrasting feedback mode, 
designed as a test of the relative effectiveness of the two types of feedback 
in shaping trainee prompting behavior. As a result, improvement in the use of 
all five prompts was obtained by all trainees, with CATTS feedback group showing 
a significantly smaller percentage reduction of rH (table 5). 

The behavior of trainees during the third trial (teaching with feedback) 
was of interest from the point of view of the effectiveness of feedback on trainee 
behavior. We have already seen that in this simple, noncontingent situation, 
trainee^ decision making was demonstrated over trials by changes occurring in 
the direction predicted. Trainee behavior after imposition of feedback (during 
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the third trial) showed that there were no significant differences between 
the two feedback groups in the mean percentage use of each functional prompt. 
However, differences between the two feedback groups in the variance of the use 
of each prompt were significant. For example, while the CATTS feedback group 
showed a mean of 24.22% use of context prompts compared to 31.60% use of con^ 
text, by the audio FB group, the CATTS group standard deviation was 5.80% while 
the audio group SD vas 23.42%. Overall, the variances for the CATTS FB group 
were significantly lower than for the audio TB group (Table 6)., Thus, training 
effects can be seen not only in the direction of the behavior change but in the 
homogeneity of trainee behavior under real tine (CATTS) feedback conditions. 

The relationship of Recall Interview categories to trainfee behavior . 

Correlations of Recall Inter-ziew categories with rT and rH coefficients 
and trainee prompting success rates were run in an effort to validate the 
Stimulated Recall Interview scale. However, the small number of subjects in 
the study made this anticipated procedure an inconclusive one and the results 
could not be used to establish the validity of the scale. Nevertheless, the 
intrinsic logic of the changes in the Recall Inte wiew data over trials, lends 
credence to the interview as a viable measure of trainee recall of decision^making. 

The data obtained from the correlations of ':he three Recall Intervxew 
categories (pupil focus, instructional focus, restatements), a total interview 
score, the rT and rH coefficients, and success rate, are shown in Table 7. Of 
interest here is the indication that the more contingent decision making (as 
evidenced by rT), the less likely was the trainee to supply restatements of 
behavior in lieu of an explanation of that behavior. The variable rT (percent 
reduction ot relative response uncertainty) , which was found to show a small 
nonsignificant increase over trials (Table 2), also showed a significant negative 
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correlation to trainees' restatement of behavior as a response to probes aimed 
at imcovering the rationale for behavior, during the first and third trials^ 
Iterative responses also showed a significant negative correlation with the 
variable rH during the second trial. 

At each trial, success rate showed a negative correlation with the total 
interview score, indicating that the greater the success in prompting, the 
fewer different statements the trainee made in response to the interview. This 
finding could indicate a weakness in the interview technique or it may possibly 
mean that trainees who generate a great number of reasons for their prompting 
behavior are less effective in prompting. 

In the third trial, trainee success in prompting showed a negative corre- 
lation with statements focusing on pupil variables, whereas a positive correlation 
between success and instructional focus was obtained in the same period. Assuming 
the scale is valid, this would indicate that by the end of the practicum, the 
more successful trainees reported basing their prompting decisions on instruc- 
tional considerations than on pupil related variables. 

Conclusions . The study of teacher decision making has great relevance for 
improvement of teacher education programs. The depth. of the teacher's knowledge 
of relevant pupil and instructional factors, together with the range of decision 
alternatives employed in the interactive teaching situation must be accounted 
for if the qualitative aspects of teacher behavior are to become amenable to 
training intervention. Teacher behavior research has in the past placed heavy 
emphasis upon the quantitative dimensions of teacher behavior. The limitations 
of the quantitative approach in the improvement of teacher training has probably 
been of significance in the more recent interest in teacher decision making 
behavior (c.f.Gage, 1975). The present study indicated^ that trainee decision 
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niaking is susceptible to training interventl-Qn and thus provides a useful mea- 
sure of the training programs* effectiveness • The reasonable next step in 
tfiis line of study would be to establish th^ validity of the teacher training 
program through examination of trainee decision making and its relationship 
to pupil outconies. 
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4, The Effect of Pupil -Tutor Exchange 



on Teaching Perfomance 



Problea Statement 

Teacher effectiveness research has recently shifted away from research 
on the effectiveness of generic teacning skills ^ such as praise and manage- 
ment, to an emphasis on the effectiveness of certain specific behaviors 
within varying contexts. One teacher behavior does not have the same 
effect on all students, as Good and Power (197S) point out. ''Recent wr :*k 
...have applied final documentation to the view that teachers' behavior 
does not have generally salubrious effects upon all students" (p. 2-3). 
For example, Brophy and Evertson (1974), in an investigation of process- 
product relationships in schools with high student socio-economic status 
(SES) and schools with low student SES statiis, found distinct differences 
in the kinds of teaching behaviors that were effective with th-e two r/pas 
of students. Student characteristic variables, such as achievemeuT poten- 
tial, actual achievement level, and achievement motivatiion, camnot ibe 
ignored in teacher effectiveness research. 

A second important contextual variable i5 instruct:ional content. 

Joyce (1975) argues persuasively for the control of content in teacher 

effectiveness research. He points out that studies that have controlled 
» 

content find much more consistency in teaching effectiveness than those 
not controlling this variable. The previously cited work by Brophy and 
Evertson (1974) used product measures in two subject areas — reading and 
math. There were many cases where the process variables correlated signif- 
icantly with pupil achievement in one subject area but not in the other. 
Even student achievement in different skill areas within the same subject 
area, such as vocabulary and comprehension in reading, can be significantly 
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related to different t^faching behaviors, as Soar (1966) demonstrated. 

With the development of conpetency-hased teacher education (CBTE) 
programs, teacher training has focused more on specific teaching skills 
within subject areas. However, a strong decision-making component, in 
which contextual characteristics are weighed before teaching, has yet 
to be included in CBTE, According to Shavelson (1973), teacher decision- 
making and planning are the basic teaching skills. His model assumes 
that two sources of information must be taken into account simultaneously: 
information about the state of the learner (e.g., skills and motivation), 
and information about the possible effectiveness of different instruction- 
al moves with the p^irtlc ar learner. CI ?*ri; and Joyce (1? 75) suggest that 
neither more accurate per^::!jption of studeznr characteristics nor a trained 
repertoire of skills axe .Ikely by themselves to be associated with pupil 
outcomes, but that the twc areas must be coordinated. 

Teacher trmining in E:i;ills, therefore, can be of two basic types: 
1) generatiom of a specific repertoire of behaviors, and 2) modulation 
of th^ie behfflvAors through decision-making in order to select behaviors 
appropriate to the context in which teaching is occurring. It can be 
hypothesized that training teachers to generate a specific repertoire of 
behaviors does not necessarily mean that they will be able to modulate 
these behaviors appropriately when placed in a new context. The present 
study sought to test this hypothesis. 

The purpose of the study was to examine the effects on teaching per- 
formance when teacher trainees (each of whom had tutored the same pt^il 
for 30 hours) were fsach given a new pupil to instruct* It was assumed 
that trainees' knowledge of learner characteristics would be much higher 
imd^more veridical for those pupils with whom they had worked for 30 hours 
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in a reading practicun. Thus, one independent variable was Trials - Trial 
1, original pupil; and Trial 2, new pupil. The second independent vari- 
able was pupil reading level. Because pupils at the same reading lev«l 
have fairly similar skills, teachers niay still be able to modulate beha- 
vior successfully when given an unknowTi pupil ?x the sane reading level 
as the known pupil. With a new pupil at a very different level, however, 
performance could be more or less successful, depending on the reading 
levels of the two pupils. In the present study, theie were three cate- 
gories of the reading level factor: (i) trainees given new pupils at a 
much lower reading level than their original pupils, (2) trainees given 
new piqpils at ^proximately the same level, and (3) trainees given new 
pupils at a much higher level. The d;isign was a 2 (trial) by 3 (groups) 
design, with subjects nested in groups. The dependent variables wei« of 
two types - f]) generation, or a measure of what teacher behaviors were 
used, and (2) modulation, a measure of the appropriateness of the teacher 
behavior for the pupil. 

METHOD 

Subjects 

The subjects were 19 pre-service trainees who had participated in a 
reading practicum during the school year, 1975-1976. All were juniori and 
special education majors at Indiana University. None had any prior teach* 
ing experience. 

The pupils with whom the trainees worked were from regular (grades 2 
through 6) and special education classes in the Monroe County Schools. All 
were at least one year or more behind in their reading achievement when 
compared to grade placement. At the end of the practicum, the average 
reading level of the 19 pupils was 3.0, and the range was 1.4 to 4.9. 
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Table 1 

Background Data on Pupils in Tutoring Progran 











Audio 


Feedback 


Tutors CN'=1^) 






Tutor 


No. 


Pupj 1 


Age 


Sex 


Grade 
Placenent 


Nc • 0 f 
Grades 
Reported 


Instr. Reading 
Level Oct, 76 
(Koodcock) 




P.eadcbility 
Level 


1 




H.B 


9.8 


F 


3 


1 


3.3 


4.0 


2 




J.J. 


9.7 


M 


4 


0 


3.-0 


4.0 


3 




C.S. 


10.9 


f! 


3 


1 


1.4 


.4 


5 




M.Z. 


12.6 


M 


6 


0 


1./ 


.8 


S* 




A.M. 


8.3 


M 


2 


0 


1.7 


2.4 


7 




T.A. 


9.9 


M 


3 


1 


3.1 


2.S 


11 




K.J. 


8.5 




2 


* 0 


3.0 


2.0 


11* 




M.Z. 


12.6 




6 


0 


1.7 


.8 


13 




D .S. 


9.0 


v« 


3 


0 


2.5 


2.5 


14 




E.S. 


8.1 


M 


3 


0 


2.9 


3.2 


16 




M.C. 


. 13.0 


M 


6 


0 


8.5 


3.0 


16* 




G.M. 


8.7 


F 


2 


1 


1.6 


.8 


17 




A .C. 


9.5 


F 


3 


1 


2.7 


2.0 


CATTS Feedback Tutors (N=9) 


4 




A.M. 


8.3 


M 


2 


0 


1.7 


2.4 


4* 




K.S. 


9.6 


M 


3 


0 


' 2.7 


2.0 


6 




L.P. 


8.8 


F 


2 


1 


1.5 


.8 


8 




J.R. 


8.11 


^^ 


3 


0 


2.3 


2.5 


9 




J.L. 


10.4 


^! 


3 


1 


2.8 


2.4 


10 




M.S. 


8.2 


F 


2 


0 


2.1 


2.4 


12 




D.B. 


13.3 


M 


6 


1 


3.6 


3.2 


15 




W.F. 


9.11 


M 


4 


0 


3.6 


3.2 


19 




M.S. 


8.5 


M 


2 


0 


1.2 


.8 


20 




T.C, 


•9.4 


M 


2 


1 


2.1 


2.5 




Semester Chile' 


for that 


Tutor 


• - • 
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(Scores are grade equivalents from the Woodcock Reading Mastery Tests 
(Woodcock, 1973} and are the total instructional reading level as ieter- 
adned by the posttesting for the practicun.) 

Pi^ils were initially paired with trainees for the practicum in a 
randwa manner, after working around scheduling problems. In the first 
two weeks of che practicum in October, several pupils with no handicaps 
in reading were dropped and replaced with handicapped readers. After this 
point, however, 16 tutor-pupil dyads remained together from October to 
April. Due to significant improvements in reading level of srae of the 
students, changes occurred at the end of the first semester. Three tutors, 
one in each group, received a new pupil at t'le beginninj of second senes- 
ter. Thus, 16 tutors had 30 hours of experience with their pupils and 
three had 21 hours. 
An Overview of the Practicum 

The practicum began on October 13, 1975, and continued to April 22, 
1976, for a total of 37 lessons. Each trainee taught two hours a week, 
one hour each lesson. Tutoring was done after school hours from 3:30 to 
5:30 in the afternoon. 

One purpose of the practicum was to instruct trainees in diagnostic 
and remediation techniques for handicapped readers. The practicum followed 
a diagnostic-prescriptive approach, with trainees required to pretest in 
order to establish skill needs, to set objectives, to construct/select 
materials, to teach; and then to posttest in order to determine whether 
or not mastery had been reached. The skills focused on were coii5)reh6nsion 
and decoding (phonics, structural analysis, and context). All trainees 
were supervised during teaching, and each received six conferences with 
a supervisor during the year. 
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A second purpose of the practicum was to conduct research in teacher 
training. This research focused on trainee behavior during oral reading 
strategy lessons. The strategy lessons were designed to develop, in pupils, 
functional decoding strategies; that is, to effect a decrease in omissions, 
sounding out, and letter naming, and to effect an increase in real word sub- 
stitutions, mis cues which fit semantically, and self-corrections. All 
trainees received instruction with a module designed to increase specific 
teacher behaviors during the strategy lessons. The Prompting Module (Brady, 
1975) and the CATTS-OROS teacher training program had the following teacher 
performance objectives: 

1. Pronq)t only meaning change (21)^ mis cues. 

2. Do not prompt any} no-meaning change (22) miscues. 

3. Increase the use of the five Prompting Module prompts: 

(a) Structural (33). Teacher asks or tells piq)il to identify syllables 
in an unknown word. 

(b) Attention (34). Teacher focuses the pupil's visual attention on 
all of an unknown word. 

(c) Pattern (44). Teacher gives, or asks pupil to give, a rhyming 
word or word family cue to an unknown word. 

(d) Phonics (45). Teacher gives, or asks for, a phonics rule or sound- 
letter correspondence within an unknown word. 

(e) Context (52). Teacher asks for, or gives, information about the 
meaning of the sentence or story in which the unknown word appears. 

4. Increase the total percent in use of all module prompts (Tot. Mod.), 
i.e., the sum of the five behaviors (a through e) listed above. 

5. Increase the success rate for each module prompt in 3 above. 

6. Inci'ease the success rate for the total percent of all module prompts. 

7. Supply the pupil with the target word, if the first two prompts for it 

1 Numbers represent category numbers in the observation system, to be explained^' 
subsequently. 
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are unsuccessful, 

8, Decrease or eliminate all other categories of non-module prompts (Other) 
A set of decision rules as to when to use each kind of prompt in order to 
achieve the goal of pupil independent decoding was also included. These 
rules related to consideration of pupil characteristics (reading skills, 
and previous behavior in strategy lessons), kind of miscue made, and text- 
ual characteristics (the nature of the word in which the miscue appeared 
and the sentence/story being read) . The teacher behaviors were derived 
from studies of reading strategies of poor and mentally retarded readers 
(cf. Levitt, 1972; Biemiller, 1970; Cohen, 1975), field observations (Lynch 
and Epstein, 1974), and behaviors in Minicourse 18: Teaching Reading as 
Decoding (Ward and Skailand, 1973). 

Throughout the practicum, each trainee taught a 15-rainute oral reading 
strategy lesson during each tutoring session. Pupils read at a level 
approximately one level above their instructional level in order that a 
sufficient number of miscues would be made. Pupils read passage^ from the 
New Open Highways series or the Lippincott series. In the first semester, 
all trainees received the Prompting module. This module, in its self- 
instructional format, did not significantly increase the percent of each 
of the five module prompts. 

During the second semester, all trainees received discrimination train- 
ing using an observation system, paying particular '^attention to the five 
module prompts. Then, -for Lessons 5 through 17 in second semester, all 
trainees received one of two feedback conditions, either on-line and delayed 
feedback through a computer- assisted teacher training system (CATTS) (Semmel, 
1975), or delayed audio feedback in which trainees coded their own beha- 
vior. The information given in each feedback condition contained the 
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frequency and percent of each of the five module prompts. Trainees were 
told that each separate module prompt should occur at least 15% of the 
time, with the total of the five (Total Module) occurring 75% of the time. 
No direct supervision of lessons was given by supervisors, since the pur- 
pose of the research second semester was to test the effectiveness of the 
two feedback conditions given above. After Lesson 17, feedback conditions 
were switched and additional information was added - the success rate of 
each prompt. Lesson 23 was the last lesson for most tutors. 

Analysis of the trainee performance for Trials 1 through 21 revealed 
significant increases across trials in behaviors generated and in success 
rates, but no differences between the two groups. 
Observation Procedures 

All les . IS were tape-recorded and also coded live by five trained 
coders on the Oral Reading Observation System (OROS) (Brady, Lynch, and 
Cohen, 1976). this system classifies pupil miscues, teacher prompts, 
pupil answers to prompts, and teacher feedback and management, into 25 
categories. Coders were randomly assigned to tutors, within scheduling 
constraints. Since special booths were used in which to conduct oral 
reading lessons, tutors were always aware that they were being coded. 
During the second semester, the purpose of the coding was also known. 

All coders were trained at the beginning of the practicum with the 
ORGS Observer's Training Manual (Brady ot al., 1976), and all had periodic 
maintenance checks throughout the year. On a simulation tape used for a 
maintenance check approximately two weeks prior to the date' of the study, 
the mean agreement with the criterion was .86 (range, .80 to .91) and the 
mean intra-coder agreement was .92 (range, .87 to .93). Coefficients 
reported are a corrected version of Flanders* modification of Scott's 



procedure (Frick and Semmel, 1974). 
Dependent Variables 

Five categories from OROS - ''3V\ ••34'', ••44'\ 'MS'', and »'52" - and a 
collapsed category for the total of these module prompts, were the six 
generation dependent variables. For each tutor, the total frequency of all 
prompts following mis cues was found and then the frequency for each sepa- 
rate category was divided by the total prompts in order to get a percent 
for each category. 

The remaining six dependent variables were modulation variables. 
Teacher ability to modulate behavior, or to select the most appropriate 
behavior based on pupil characteristics, was measured by the success rates 
of the prompts. A prompt was considered successful if it was attenpting 
to decode. For each of the categories in the paragraph above, the total 
frequency of successful prompts within the category was divided by the 
total frequency of prompts in that category in order to get a success rate. 
Procedures 

There were 19 tutor-pupil dyads in the practicum. An additional pupil 
who had two tutors during the second semester was included as a switch 
pupil, but the tutors were not. Reciprocal switches between dyads were 
made; i.e., if Tutors 1 and 2 were paired. Tutor 1 taught Tutor 2's pupil 
for the switch lesson and Tutor 2 taught Tutor I's pupil for the switch 
lesson. During each one-hour time period, there were from four to six 
tutors. Tutors per time period were listed alphabetically and paired from 
the top; i.e., 1 with 2, 3 with 4, etc. 

Tutors kne^ in advance that a switch would be made. They were told 
that ?t would only occur for the 15 minutes of the oral reading lesson. 
Tutors were not informed of the purpose of the switch. They were told to 
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continue doitig everything with the new pupil that they had been doling with 
their original pupil. Thus, their goal was to use the five module prompts, 
each about 15% of the time, and to have successful prompts. Each pupil 
read material from the book they were currently reading with their original 
tutor. In most cases, a different section of the same story was used. 

The switch lesson occurred at Lesson 22 for 15 of 19 tutors, and at 
Lesson 23 for 4 tutors. Tutors continued to receive their same feedback 
condition during the switch lesson. To control for order effects, 10 tutors 
were coirpared to a lesson with their original pupil that occurred one les- 
son before the switch, and nine tutors were compared to a lesson with their 
original pupil that occurred one lesson after the switch. Trial 1 was 
always the original pupil lesson, but for half the tutors in each group, 
this original lesson occurred one lesson before the switch lesson, and for 
the remaining tutors, one lesson after* 

The total scores of pupils on the Woodcock Tests were used to assign 
pupils to groups. All tutors who received a new pupil at least one year 
or more lower in reading level than their orlg nal pupil were assigned to 
Group 1, high to low. Those whose new pupil's score was the same or within 
.4 months of the original pupil's score were assigned to Group 2, same. 
Tutors who received new pupils reading at least 1 or more years higher than 
their original pupils were assigned to Group 3, lov; to high. 

RESULTS 

Table 2 shows means and standard deviations for all dependent variables 
by groups and trials. - The Woodcock scores (used to block by groups) reveal 
that for Group 1 (high to low group), there is a mean decrease of 1.6 in 
pupil reading level. For Group 2 (same), the mean reading level is identi- 
cal. For Group 3 (low to high), there is an increase of 1.6 in pupil reading 



Table 2 

Means (and Stpndard Deviations) for all 
Dependent Variables by Groups and Trials 
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Gl (N=7) 



Variable 
Woodcock 

%33 

%34 

%44 

%4S 

%52 
Tot. Mod. % 
'SR 33 
SR 34 
SR 44 
SR 45 
SR 52, 

SR Tot. Mod. 



Tl 



T2 



3.814 
(.495) 
25.286 

(15.261) 

11.571 

( 7.807) 
3.286 

( 4.348) 

11.571 
( 7.480) 

13.714' 
( 9.552) 

65.429 
(13.649) 

45.143 
(26.686) 

50. 714 
(40.905) 

25.714 
(44.293) 

24.857 
(25.47 

49.28 
(33.«.'5J 

52.286 
(17.192) 



2.243 
(.808) 

11.714 
(11.116) 

8.571 
( 8.753) 
9.429 
( 7.591) 
9.429 
( 9.589) 

20.143 
(24.327) 

59.286 
(16.276) 

42.143 
(31.222) 

52.429 
(40.975) 

39.857 
(^~.998) 

, 129 
(37.977) 

30. 714 
(20.670) 

48.857 
(16.537) 



G2 rN=6) 



Tl 



T2 



3.117 
(.325) 
16.333 

(14.334) 

15.500 
( 7.918) 
9.167 
( 7.705) 
7.833 
( 6.178) 

14.333 
(10.801) 

63.167 
( 9.131) 

48.500 
(35.999) 

23.667 
(27.897) 

55.333 
(45.478) 

26.833 
(26.687) 

44.333 
(23.972) 

51.167 
(12.254) 



3.117 
(.325) 

25.000 

(12.649) 
7.333 

( 4.033) 
9.333, 
(10.093) 

12.000 
ClO.040) 

10.833 
( 7.653) 

64.500 
( 9.460) 

65.667 
(29.214) 

47.167 
(41.330) 

58.333 
(49.160) 

48.500 
(37.389) 

52.667 
(32.290) 

64.000 
(16.038) 



G3 (N=6) 



Tl 



T2 



2.000 
(.537) 

20.500 

(13.620) 
9.667 

(12.356) 

15.833 

(11.771) 
1.667 
C 1.862) 

21.833 
( 8.110) 

69.500 
( 9.418) 

44.667 
(29.555) 

35.500 
(42.208) 

71.333 
(38.344) 

25.000 
(41.833) 

35.833 
( 9.304) 

52.000 
(14.778) 



3.633 
(.137) 

20.667 

(11.237) 

15.500 

(14.068) 
5.000 
( 5.727) 
5.333 
C 4.179) 

17.333 
(14.706) 

63.833 
(18.368) 

46.333 
(32.904) 

61.333 
(38.479) 

36.833 
(40.598) 

45.833 
(51.031) 

43.333 
(23.517) 

54.500 
(9.915) 



*Success Rate 
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level. Thus, assignment to groups was as Intenf^ed. 

Table 2 also shows little difference across trials for each group, 
for the two composite variables, total module (Tot. Mod.) and success rate 
of total module (SR Tot. Mod.). The repeated rneasures of ANOVA's on these 
variables in Tables 3 and 4 show no significant sources of variance. There- 
fore, tranees were able to maintain a hifih rate of generation (approximately 
65%) and a moderate success rate (approxii^ateiy So%) when given a new pupil 
with whom they had had no previous exjierience or knoviedge, regardless of 
the reading level of the new pupil. 

A multivariate analysis of variance ^as ru" on the percents of the 
five module prompts. Only the interactit>»^ term VaS significant (F = 2.379, 

df = 10 df = 24, p< .040). Therefore, reading level in combina- 

"/P error » « ^ 

tion with pupil familiarity does appear to influence the tutor's ability 
to generate prompts. Univariate analysi? of these S measures were then 
run in order to look at the effects of e^ch sepa^teiy. Table 5 shows a 
summary of these repeated measures ANOVA's for the interaction term only. 
Univariately, only "44" is significant. In Figure 1. cell means are dia- 
grammed for "44" prompts. Group 1, High to LoW readers, increased use of 
"44" prompts when given an unknown pupil ; group 2, Same level, generated 
the same percent of "44" prompts; and group 3, Low to High, decreased use 
of "44" prompts. Thus, when considered ntultiva^iately, reading level does 
interact with knowledge of pupil in affecting teacher performance. Uni- 
variately, this interaction is significi^^^t onl/ for "44" prompts. Neither 
knowledge of pupil nor reading level altJ^^e appeared to affect performance. 
Figure 1 also shows cell means for the cither four module prompts. 

The success rates of each module prompt were also analyzed muUivari- 
ately. Table 6 shows the results of this anaJ/sis. No sources of variance 
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Table 3 

Repeated Measures ANOVA on Total Percent Module Prompts 



Source ic 

^ MS F p< 

Between Subjects 

Groups 122.163 2 f,i nsi ' , o 

S'^'G 3164.048 16 il^-'H "^"^ -739 

Within Subjects 

''"rials 125.289 1 19c ,.0 

Residual 2:,37.762 J J^.'^^o 



Table 4 

Repeated Measures /\NOVA on Success Rate 
of Total Percent Module Prompts 



Source SS 



Between Subjects 



Within Subjects 



df MS 



Groups 320.24 7 2 ■ lAn lo. , 

SWG 2187.595 10 156:725 ' 



^"^^^ 121.684 1 121 r,84 -ni 

GT 432.292 ' IVf Ar ''f.l ''''^ 

Residual 4847.024 le 3^2:959 ' 



Table 5 

Summary of Repeated Measures ANOVA's on the 
Percent of liach Module Prompt for the Interaction Term Only 



Source 



Variable 



F(df) 



MS 



GT 



%35 

?o52 



(2.16) 

1.508 
1.579 
5.806 
1.257 
.762 



411.819 
150.715 
236.316 
40.770 
120.953 



,251 
,237 
,013 
, 317 
,483 



Table 6 

Repeated Measures MANOVA on the Success Rate of Each 
Module Prompt (•'33", "34", "44", "45", "52") (First Roots Only Reported) 



Source 



df 



hyp 



df 



err 



P< 



R(Canonical) 



Group .412 
Trial .971 
GT 1.107 



10 
5 
10 



24 
12 
24 



.927 
.473 
.397 



,467 
,537 
.705 
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■ Figure 1. Mean percentage use of each module prompt with original (trial 1] 
pupil and new (trial 2) pupil. 
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are significant. Tutors, therefore, maintained ability to modulate and 
select appropriate prompts regardless of pupil reading level or prior 
experience with the pupil. Univariate ANOVA's were also run on success 
rates, and one was significant, trials for SE 'MS'* (F » 4.47, df = 1 , 16, 
p < .05). A look at Table 2 reveals that the success rate for "45** approx- 
imately doubled across trials for each group, thus increasing when tutors 
worked with an unknown pupil. In general, however, success rates of the 
module prompts did not significantly change when tutors worked with a new 
pupil, regardless of pupil reading level. 

DISCUSSION 

Given a group of subjects trained to criterion after 19 lessons of 
feedback, it appears that, as a total group, subjects can maintain both 
generation and modulation of behaviors when given a new pupil. For the two 
conposite variables, total module percent and success rate of total module, 
there was very little difference across trials. 

The results of the multivariate and univariate analyses on the per- 
cents of the separate variables verify this, with the exception of "44" 
prompts. Other variables approached significance for the interaction terra, 
but suggest inconsistencies in maintenance of behavior when the cell means 
are studied. It is quite possible that this inconsistency is due to the 
nature of the behaviors, responses to pupil miscues, and not to trainee 
inconsistency. Only three of the prompts can be used with any word, "34", 
"45"i and "52". Two of these, "34" and "45", show the smallest change 
across trials for each group. Variable "52" shows the largest increase 
across trials for Group 1, high to low. Since these trainees were work- 
ing with new pupils much lower in reading level than their original pupils, 
their uncertainty as to what specific skills the nw pupil had may have led 



them to give more general *'52'* prompts, e.g., "Does that sentence make 
sense?" Two of the prompts, "33" (structural) and "44" (pattern), can only 
be used when a miscue occurs on a certain kind of word, multisyllabic and 
word family, respectively. Group 1, high to low, shows a decrease across 
trials for "33", possible due to the lower frequency of multisyllabic words 
at beginning reading levels. Group 1 shows an increase in "44", pattern, 
across trials, as would be expected due to the high proportion of one- 
syllable words that fit in word families at low reading levels. If this 
is correct, then Group 3, low to high, should have performed exactly the 
opposite of Group 1 for these two variables. However, Group 3 showed no 
change across trials for "33", but these subjects did decrease sharply in 
their percent of "44" prompts across trials. Group 2, tutors who iid not 
change reading level, showed no change across trials for "44", but a slight 
increase for "33". 

The above discussion suggests that the characteristics of the instruc- 
tional materials used may have been a stronger influence on teacher beha- 
viors than pupil reading levels. It is apparent that studies investigating 
teacher word recognition strategies cJuring oral reading lessons must have 
tight control over textual characteristics. Group 2, in which textual 
characteristics were most similar, showed the smallest changes over trials. 
Control of text may not be sufficient, however, since the teacher behavior 
being investigated only occurs after the pupil has made a miscue. Weinstein 
(1976) found that comparisons among reading groups on a similar variable, 
teacher treatment of wrong answers, was dubious because of the varying pro- 
portions of errors in the reading group, since with a low or zero error 
rate, no teacher behavior was required. Error rate can easily be controlled 
in studies such as this, but control over the exact words upon which pupils 
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make raiscues is extremely difficult. Word characteristics, however, do 
exert some control over the possible subsequent teacher response. 

In general, the trainees maintained the same levels of behaviors when 
given a new pupil. Therefore, once pre-servlce teachers are specifically 
trained on a repertoire of behaviors, they are able to generalize to the 
new context of a pupil with whom they have never worked. The success 
rates of the generated behaviors are fairly moderate, even after training. 
This may be dwe to the fact that only four lessons were devoted to feed- 
back on success rate. Further investigations of the effects of training 
in decision-making during interactive teaching (with the hoped result of 
increasing success rate to 75% or so) are necessary in order to determine 
how relevant knowledge of pupil characteristics is tc high success rates 
of teacher behavior. 
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5. Outcomes for Pupils Participating in the 
C ATTS PROS Reading Tutorial Program 
The purpose of this section is to present pupil outcome data collected 
during the CATTS-OROS practicum for pre-service teachers of the mildly 
handicapped. Although the focus of the teacher training program was on the 
development of trainee prompting skills, evaluation procedures were instituted 
to determine the effects of these trainee prompting skills on pupil behaviors, 
including the following: 1) pupils' verbalized and actual decoding strategies, 
2) pupils' attitudes toward reading. 3) the general effect of practicum 
' procedures on pupil achievement. 4) the types of miscues made by pupils during 
. oral reading. 

METHOD 

Subjects 

Pu£ils. There were 20 pupils from regular and special education classes 
who had moderate to severe reading deficits and were referred to the tutoring 
program by their teachers. Priority for acceptance into the after-school 
program was given to children referred by their teachers for difficulties in 
oral reading, word recognition and word analysis skills. 

Criteria for admission into the tutoring program included a reading level 
at least one year behind actual grade level for second and third grade pupils, 
and at least a two-year deficit for pupils in the 4th, 5th, and 6th grades. 
Pupil selection procedures are described in Chapter I of this report. Each 
pupil was assigned to. a tutor arid, except for a few changes between semesters, 
each pupil remained with the same tutor for the two-semester program. Pupils 
received one hour of tutoring in a laboratory classroom at CITH, twice a week. 
Most pupils received a total of 10 to 12 hours of tutoring during the first 
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semester and between twenty and twenty-two hours during the second semester. 

Initially, 20 pupils were admitted to the program^with about six pupils 
on a waiting list. Several pupils were dropped from the program because they 
did not meet the criteria for reading deficit even though they were initially 
referred because of reading problems. Table 1 shows the relevant background 
data on pupils in the practicum. The table indicates the age, sex, grade 
placement, number of grades repeated, instructional reading level, and read- 
ability level of their basal reader during October, 1976. Data for pupils 
who were new in the program second semester were based upon January, 1977 
test scores. There were 15 boys and 4 girls in the program. Mean age was 
9.7 years with a range from 8.1 to 13.3 years. Pupils were drawn from 
grades 2 to 6, and 9 of 19 pupils had been retained in grade for a year. 

Tutors . There were 20 pre-service teacher trainees who participated in 
the CATTS-OROS practicum. They were all majors in Special Education and had 
completed 12 hours of course work on teaching the mildly handicapped. All i 
were concurrently enrolled in courses on theory and methods of reading and 
teaching the mildly handicapped. As part of the CATTS-OROS practicum, the 
trainees were required to assume responsibility for tutoring a pupil in need 
of remedial instruction, Practicum requirements are described in greater 
detail in Chapter I of this report. 

Tutors received specific training designed to develop their skills in 
prompting pupils' oral reading miscues. CATTS and audio tape feedback were 
provided to the trainees to aid in development of specific prompting skills. 
Sections 1 and 2 of Chapter III of this report discuss the results of these 
training and feedback methods. 

It was anticipated that trainee ability to generate appropriate prompting 
strategies would produce concomitant changes in pupil decoding strategies. Pupil 
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Table 1 

Background Data on Pupils in Tutoring Program 



Audio Feedback Tutors CN- 1 0 ) 



Tutor No. 


Pupil 


Age 


Sex 


Grade 
Placement 


N'c. of 
Grades 
"Reported 


Instr. Readine 
Level Oct, 76 
(IVoocccck) 


Level 


1 


H.B 


9.8 


F 


3 


1 


3.3 


4.0 


2 


J.J. 


9.7 


M 


4 


0 


3'.0 


4.0 


3 


C.S. 


10.9 


M 


3 


1 


1.4 


.4 


5 


M.Z. 


12.6 


M 


6 


0 


1.7 


.8 


5* 


A.M. 


8.3 


M 


2 


0 


1.7 


2.4 


7 


T.A. 


9.9 


M 


3 


1 


3.1 


2.5 


11 


K.J. 


8.5 


M 


2 


0 


3.0 


2.0 


11* 


-M.Z. 


12.6 


M 


6 


0 


1.7 


.8 


13 


D .S. 


, 9.0 


M 


3 


0 


2.5 


2.5 


14 


E.S. 


8.1 


M 


3 


0 


2.9 


3.2 


16 


M.C. 


13.0 


M 


6 


0 


8.5 


3.0 


16* 


Ci .M. 


8.7 


F 


2 


1 


1.6 


.8 


17 




9.5 


F 


3 




2.7 


2.0 








CATTS Feedback 


Tutors (N=9) 






4 


A.M. 


8.3 


M 


2 


0 


1.7 


2.4 


4* 


K.S. 


9.6 


M 


3 


0 


2.7 


2.0 


6 


L.P. 


8.8 


F 


2 


1 


1.5 


.8 


8 


J.R. 


8.11 


M 


3 


0 


2.3 


2.5 


9 


J.L. 


10.4 


M 


3 


1 


2.8 


2.4 


10 


M.S. 


8.2 


F 


2 


0 


2.1 


2.4 


12 


D.B. 


13.3 


M 


6 


1 


^ 3.6 


3.2 


15 


W.F. 


9.11 


M 


4 


0 


3.6 


3.2 


19. 


M.S. 


8.5 


M 


2 


0 


1.2 


.8 


20 


I.e. 


9.4 


M 


2 


1 


2,1 


2.5 
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decoding strategies were ascertained through analysis of pupil behaviors 
following a miscue made while reading from continuous text. Since all oral 
reading lessons were coded with the ORGS system, data on the sequence of 
pupil behaviors were available for miscue analysis. 

The intention of each of the prompting strategies (behaviors) that 
trainees were taught was to encourage the pupil to apply decoding strategies 
independently. The specific teacher strategies taught in this program are 
summarized as follows: 

1. Prompt only meaning-change miscues. 

2. Do not prompt any no-meaning-change miscues , 

3. Increase the use of the five strategic module prompts which are: 



(a) Structural . Teacher asks or tells pupil to identify syllables 
in an unknown word. 

(b) Attention . Teacher focuses the pupil's visual attention on 
all of an unknown word. 

'■(c) Pattern , Teacher gives, or asks pupil to give, a rhyming 
word or word family cue to an unknown word. 

(d) Phon ics. Teacher gives, or asks for, a phonics rule or sound- 
letter correspondence within an unknown word. 

(e) Context . Teacher asks for, or gives, information about the 
meaning of the sentence or story in which the unknown word 
appears. 



achievement, verbalized decoding strategies and on actual decoding strategies* 



Assessment and Diagnosis 



Upon entry into the tutoring program, pupils were assessed on attitudes. 




When the prograa was initiated in October, data for all pupils were obtained 
frost the following sources: 

1. Woodcock Reading Mastery Tests 

2. Inforaal Reading Inventory (IRI) 

3. Pupil Perceptions of Reading Interview 

4. Miscue analysis using OROS observation system 

When the program was concluded in April, all instruments except the IRI were 
re- administered. OROS data were collected at each lesson. A description of 
each of these instruments follows: 

Woodcock Reading Mastery Tests . The Woodcock Reading Mastery Tests 
(Woodcock, 1973) are composed of five individually administered subtests: 
Letter Identification, Word Identification, Word Attack, Word Comprehension, 
and Passage Comprehension. These tests are suitable for grades K to 12. The 
results of the Woodcock were used by the tutors as a source of practical 
instructional and diagnostic information about their pupils. 

Informal Reading Inventory . A second diagnostic measure used to obtain 
information on the pupils was an Informal Reading Inventory (IRI) (Windell, 
l'>75). The IRI was used to determine the instructional reading level of the 
pupils. This is the level at which the pupil can read approximately 90 to 99% 
of a passage correctly and correctly answer about 75% of the comprehension 
questions. 

In determining whether a child could read a passage within the 10% error 
rate, only words that significantly changed the intended meaning of the sentence 
were labeled as errors. Miscues, such as repetitions or synonym substitutions, 
were not considered errors. IRI's for the tutors to administer at the start of 
the project were developed by drawing on graded passages and word lists form the 
New Open Highways Reading Series (for sample IRI's see Appendix). The IRI's 
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given to the pupils consisted of three parts— a word list, an oral reading 
passage and comprehension questions. 

The scores from the oral reading passage and from the comprehension 
questions were used jointly to determine the reading placement level, as 
shown below: 

Reading Placement Level 

Independent level 95% accuracy 90% comprehension 

Instructional level 90-95% accuracy 75% comprehension 

Frustration level 90% accuracy 75% comprehension 

For the purpose of the oral reading strategy lessons only, pupils were placed 
one level above their instructional level in order for sufficient miscues 
(that require prompting) to occur. All other instruction was conducted at 
the instructional reading level. 

Pupil Perceptions of Reading . The third instrument used to collect 
information about the pupils was an attitude survey* The Pupil Perceptions of 
Reading Interview (Andrews, 1974), developed by a doctoral student at Indiana 
University, consisted of seven open-ended questions about reading, such as 
••What is the best (worst) thing about reading?" (See complete questionnaire 
in Appendix.) 

The Andrews questionnaire was used to evaluate children's attitudes toward 
reading and to collect information on pupils' verbalized decoding strategies. 
The open-ended interview elicited some interesting responses from the children 
(protocols of children's statements about reading may be found in Appendix), 
but it was apparent that a scoring system to organize the data collected would 
enhance its usefulness. Since none was provided, the staff of the project 
devised a three-way classification system (positive, neutral or negative) to 
rank the children's responses to the first four attitude questions. 

ER1C_ ' iiSi _^ : 
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Pupil verbalized knowlege of decoding strategies ^ Questions 5, 6 
and 7 of the interview dealt with the children's knowlege and awamess of 
how to apply word recognition strategies. Children were given the 
opportunity to provide up to three answers to questions about what they do 
when confronted with a word that they do not know. The pupil responses 
were classified into nine decoding strategy categories (Table S). The 
responses were also ranked according to the ainount of pupil independence 
in decoding indicated by the answer. Changes in pupil responses were 
measured by comparing data obtained in October at the outset of the 
program wit^ data from interviews held at the end of the program in 
April. 

Hiscue Analysis . The data on changes in pupil strategies in decoding 
were indicated by the types of miscues made during oral reading and were 
collected from observation system data of tutor-pupil interaction 
occuring during oral reading lessons. The Oral Reading Observation System 
(OROS) was used to obtain the interactive data. Pupil miscue categories 
of the OROS are as follows: 
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MEANING -CHANGE MISCUE (21)* The miscue changes the meaning of the sentence. 
MEANING-CHANGE MISCUH SUBCATEGORIES: 

No Response Miscue (210) ^ 
The pupil does not attempt the word at all, 

Letter/Syllable Miscue (24) 

The pupil makes an isolated sound for one or more letters of the word. 

No Graphic Similarity/Low Graphic Similarity Miscue (212) 

The pupil substitutes a word that has fewer than half the letters as 
letters in the text word. 

High Graphic Similarity Miscue (213) 

Thi5 pupil substitutes a word that has at least half the letters the 
saiie as letters in the text word, 

Insertion/Ooission (215) 

The pupil omits a word which is in the text or inserts a word into 
the text. 

NO'MEAN I NG- CHANGE MISCUE (22) The miscue does not substantially change 

the meaning of the sentence. 

NO MEANING-CHANGE MISCUE SUBCATEGORIES: 

No Graphic Similarity (222) 

The word the pupil substitutes is very different than text word 
(no i?ore than 2 letters the same), but the new word does not change 
the meaning of the sentence. 

High Graphic Similarity (223) 

The word that pupil substitutes is very much like the text word (3 or more 
letters the saute), but the substitution does not change the meaning 
of the sentence. 

Dialect-Based Miscue (224) 

The pupils miscue occurs because he is translating text grammar or 
words into his own language. 

Insertion/Omission (225) 

The pupil omits a word which is in the text or inserts a word into 
the text that does not change the meaning of the sentence. 



•All numbers in parenthesis are OROS code numbers. 
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Results 

Reading Achievement , The teacher training progran in which trainees 
learned and applied specific oral reading prompting techniques did co-occur 
with positive changes in the general reading performance of children who 
had previously had trouble learning to read. As seen in Table 2, the 
Woodcock Reading Mastery Test scores increased for the children on each of 
the five subtests as well as on the total reading score. The group mean 
grade level score in October was 2.4 [sd = .75), while in April the group 
mean reading grade-level achievement score had increased to 5.05 (sd = .88). 
The mean increase in reading skill for the children was, thus, greater 
than 6h months during the six months the tutoring program was in operation, 
A correlated t-test showed this increase in reading achievement scores 
between October and April, as measured by the Woodcock Reading Mastery Test 
to be significant, t(19 df) = 4.54, p< .005. 

A corroborating measurement of increased reading achievement can be 
found in Table 3 which shows the grade equivalent readability levels (as 
computed by the flarris and Jacobson readability formula (Harris 5 Sipay, 
1975) of the books the individual children were reading in April comj'ared 
to October. The group mean reading level in October was 1.74 (sd = 1.02). 
In April, the group mean reading level was 3.03, (sd = 1.17) resulting in a 
mean gain of 1.35 grades, (sd = .68). A correlated t-test showed this to be 
a significant increase in reading level, t(19 df) = 7.9, p ^.001. 

Attitudes towards reading . A comparison of the answers to the attitude 
questionnaire before and after the reading tutoring program showed that the 
number of pupils with ncp.ative or neutral attitudes toward reading both 
decreased, while the number of pupils with positive attitudes increased 
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Table 2 

h'oodcock Reading blaster;; Test Pre (October) and Post (April) Scores and Gain for all Subjects 
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CHILD 



1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 



Table 3 

Readability Level of Books used for Instruction 
in Octobe'r and April 



LEVEL OF 1ST 
BOOK READ 



28 

38 

38 

2A 

2B 

4.0 

4.0 

3A 

2A 

IB 

18 

28 

38 

2A 

IB 

IB 

28 

IC 

IB 

18 



•READABILITY 
LEVEL 



LEVEL OF LAST 
BOCK READ 



READABILITY 
LEWL 



Increase in 

* OF BOOKS EQUIVALENT ' 
COMPLETED GRADE LEVELS 



2.0 
2.5 
2.5 
2.4 
2.0 
3.2 
3.2 
2.4 
2.4 
.4 
.4 



2. 
2. 
2. 



.0 
,5 
,4 
.4 
.4 
2.0 
.8 
.4 
.4 



4.0 
I** 

J*** 

4.0 
4.0 
I 
J 

3.0 
4.0 
4.0 
28- 
4.0 
I 

4.0 

r.o 

.8 

4.0 
4.0 
2B ' 
1.0 



3.2 
4.0 
5.0 
3.2 
3.2 
4.0 
5.0 
3.0 
3.2 
3.2 
2.0 
3.2 
4.0 
3.2 
1.0 
.8 
4.0 
4.0 
2.0 
1.0 



4 
3 
4 
5 
4 
1 
1 
3 

5 

7 

4 

4 

3 

5 

2 

2 

4 

6 

4 

2 



* The Harris § Jacobson readability formulas 1 and 2 were used to determine 
these levels. 

•* Level I of the Lippincott Basic Re ading Series 

*•* Level J of the Lippincott Basic Reading Series 



1.2 
1.5 
2.5 
1.8 
1.2 
.8 
1.8 
.6 
.8 
2.8 
1.6 
1.2 
1.5 
.8 
.6 
.4 
1.2 
2.4 
1.6 
.6 
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(see Table 4). Although the changes were not statistically significant 
\t = 1,2 p .051) 7dS), the trend was toward more positive attitudes. 

• The Pupils Attitude scores were subsequently correlated with achievement 
• scores in order to determine whether any relationship existed between pupils' 
attitudes toward reading and their reading skill. Based on the October 
scores of the respective tests, a Pearson Product Moment correlation yielded 
an r of .50 (p ^ .05). The correlation of April scores however was .23 
(P<.05). 

Pupil knowledge of decoding strategies . The pupil interview permitted 
us to ascertain the number of word recognition strategies the children 
could name. Table 5 shows the number of strategies named by each pupil 
during the October interview and the number named in Aprii\ The mean number 
of strategies named in October, was 2.4 and 3.2 in April, and these changes 
were found to be statistically significant i^u^f " <[.05). 

The quality of the answers given by children in response to questions 
concerning word recognition strategies (i.e., **lVhen you^re reading and you 
* come to' a word you don't know, what do you dO"-How does that help you?") 

were ranked according to the degree of independence of the word attack 
strategy indicated by the pupil's response. Table 6 shows the mean rank for 
3 responses on the four-point scale. The mean rank for independence"^ of 
strategy was 1*87 in October and the mean was 2.22 in April, the differences 
between the two interviews were not statistically significant i^^fu = 1^30, 
p.<.05). 

The same data is. shown in Table 7, where the types responses given by 
the pupils in the study are listed, and the number of such responses given 
. in the October and April interviews are shown. 
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Table 4 

Changes in pupils' attitudes toward 
reading between October and April 






Attitude 


Index 




ouDj ects 


October 


April 


Net Change 


1 


2 


2 


0 


2 


2 


2 


0 


3 


1 


2 


1 


A 


3 


2 


-1 


5 


2 


3 ■ 


1 


6 


1 


3 


2 


7 


3 


3 


0 


8 


3 


3 


0 


y 


3 


3 


0 


10 


2 


3 


1 


1 1 




2 


1 


12 


2 


3 


1 


13 


2 


1 


-1 


14 


2 


2 


0 


16 


1 


1 


0 


17 


3 


3 


0 


18 


2 


1 


-1 


20 


1 


1 

- 


0 








Number of 


Pupils 




Attitude 


October 


April 


Net Change 


Positive (3) 


5 


8 


+3 
-2 


Neutral (2) . 


8 


6 


Negative (1) 


. 5 


4 


-1 



2SZ 
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Table 5 

Number of word recognition strategies 
named by pupils during interviews in 
October and April 





No. of Strategies 


Pupil 


October 


April 


1 


2 


2 


2 


1 


3 


3 


2 


1 


4 


3 


3 


S 


3 


2 


6 


2 


4 


7 


4 


2 


3 


3 


5 


9 


2 


4 


10 


1 


3 


11 


2 


3 


12 


2 


2 


13 


2 


3 


14 




4 


15 


2 


2 


16 


3 


4 


17 


2 


3 


18 


2 


4 



Table 6 



Ptipil Independence in Word Recognition 
Strategies Mean Rank 







Mean 


Rank 




Pupi'l No. 


Oct. 


April 




1 \ 


2.67 


2.67 


Pupil indepen- 


2 


1 


2 


dence in word 


3 


1 .33 


.67 


recognition 


4 


3 


1.33 


strategies : 


5 


2.67 


2 


scale: 


6. 


1.67 


3 




7 


3 


1.67 


3 = independent 


8 


2 


3 




9 


1.67 


2.67 


2 = dependent 


10 


.67 


2 




11 


1 


3 


1 = static 


12 


2 


2 




13 


1.33 


2.33 


0 = neutral 


14 


1.67 


2.67 




15 


2.67 


1.33 




16 


2.67 


2 




17 


1.33 


2.67 




18 


1.33 


3 




Mean 


1.87 = 


2.22 





Table 7 

Decoding strategies named by pupils 



Decoding Strategy Number of Responses 
October April 



Ask for assistance 


15 


14 


Sound out word 


12 


14 


Omit word 


5 


9 


Use phonics 


3 


2 


Spel 1 word 


1 


0 


Use context - 


1 


8 


Use structural analysis 


1 


3 


Guess 


0 


1 


Other (try it, think about, memory) 


2 


2 
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'>v 'J aiffeience in total n of the two interviews is due to the free 
response nature of the interview. Not all children supplied the maximum 
of 3 answers to the interview items; thus, difference in total n is due to 
this source of variability. The only pupil decoding strategy showing a 
positive change was the use of context cues, which was, of course, the 
teacher behavior emphasized in the training pro^l^m. 

Miscue Analysis . In order to determine if pupil strategies of 
decoding changed as a result of the teacher prompting behaviors, data was 
collected during the oral reading strategy lessons on the kinds of miscues 
made. The results are in Table 8. The October data is from Trial 1 of the 
first semester, formed by collapsing the first six lessons. The April 
data is Trial 4 of second semester, formed by collapsing the lessons 18-21 
of the second semester. 

The data was not analyzed formally siiicc (1) changes in pupils 
occurred and (2) instructional materials were not controlled. There 
appear to be few changes in individual categories. However, a sum of 
all substitution miscue categories reveals that^ in October 57.9% of the 
miscues were substitutions and^ in April, 85.1% were substitutions. This 
suggests one effect of the prompting behaviors used by tutors on pupil 
decoding strategies--an increase in pupil responding to. unknown words 
with whole words, instead of omitting the text word, or sounding it out. 
Discussion 

Pupil participation in the tutoring program was accompanied by gains 
in reading achievement over the course of the program. The tutoring program 
lasted six months^ and the average pupil gain in reading skill was 6h months 
as measured by the Woodcock Reading Mastery scores. The readability level 



Table 8 



Variable 



Means and Standard Deviations for Percents 
of all Miscue Categories by Time 

October 



X 



SD 



April 



Total 21 


76.800 


8.501 


83.263 


5.961 


210 


15.750 


13.301 


12.363 


12.495 


211 


6.050 


8.744 


3.263 


5.331 


212 


18.100 


10.794 


30.473 


10.663 


21% 




16.275 


31.578 


14.833 


215 


2.800 


2 . 353 


4.000 


3.366 


Total 22 


22.250 


8.575 


15.736 


5.961 


222 


4.200 


3.488 


2.894 


2.622 


223 


5.200 


2.876 


5.052 


3.390 


224 


7.850 


6.698 


5.842 


3.905 


225 


3.900 


3.059 


.789 


1.031 


Total 63 's 


15.550 


8.242 


12.473 


7.343 
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of the books mastered by the children likewise increased greatly over the 
course of the tutoring program. 

diven the poor educational performance of these pupils in the past 
(all had been r/eferred because of reading retardation, about half had 
repeated at leasx one grade and about a third were mai-nstreamod or special 
class pupils), the normal rate of gain achieved during their participation 
in the program would have to be seen as a 'Substantial achievement. 

The measures of chiLiren's attitudes toward reading, as elicited by 
the 'attitude interview^ did not show a significant change over the course of 
the tutoring program. This lac\. of measured attitude change could be due 
to a number of possibi lit ies--the fact that attitudes are difficult to 
change; that the G-rv.onth period was too short a time in which to measure 
such a change; that the attitude interview was not able to accurately elicit 
the information and that the scoring system was too crude; or that there 
was no change in attitude. 

In addition, the children were receiving reading instruction in their 
classes at school on a regular basis and for at least 5 hours a week, 
while the tutoring program accounted for only 2 hours. Furthermore, the 
nature of the pupils reading experiences in their own classrooms was an 
uncontrolled factor which may have affected their responses to the attitude 
interview. 

The analysis of the interview questions on the pupils knowledge of 
word attack strategies showed that there was an^ increase in the number of" 
word recognition strategies that a child could describe at the end of the 
tutoring program compared to the number that the child could describe at 

2G- 
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the beginning of the program. IvTion the pupils' verbalized strategies 
were ranked on independence, the average rank for the pupils in the program 
increased over time, although the change was not statistically significant. 
Pupils also showed an increase in their use of content cues as a 

t 

verbalized decoding strategy for dealing with unknown words. This finding 
provides some evidence that pupils were incorporating a strategy into their 
repertoire that the tutors had been specifically trained to teach. This find- 
ing also indicates that a strategy which the tutors learned had some effect ' 
on pupil behavior at the verbal level. 

At the behavioral level, there were changes in pupil raiscue patterns 
in the use of substitutions in responding to unknown words between October 
and April, indicating that pupils changed in the direction of responding 
to unknown words with whole words, rather than omitting the word or sounding 
it out. This is a strategy which indicates greater self-reliance and 
hypothesis generation by the pupil. 

The effects of the tutoring program on participating pupils may be 
summarized as follows: 1) increases in reading achievement as measured 
on a standardized diagnostic instr^inent ; 2) increases in the difficulty 
level of the books the children were able to read; 3) increases in the 
number of word recognition strategies named by pupils in response to 
questions on how they approach unknown words; 4) a trend to greater inde- 
pendence in word attack strategies named by pupil, in response to interview 
questions; 5) increase in naming context cues as a decoding strategy; and 
6) greater use of substitutions in dealing with unknown words during oral 
reading. 
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These effects were obtained from multiple evaluation sources; standardized 
t^sts, observation data and pupil responses to interviews. While the gains 
made by pupils could not be directly related to the teacher training strategies, 
there wore positive outcomes for pupils and a nu>nber of findings which suggested 
a relationship between certain pupil behaviors and the teacher training 
interventions. 
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Introduction 

; 

The tutoring program you ?re participating in this year is designed to 
meet the following objectives; 

1. To provide a laboratory classroom in whicli to practice and develop 
selected toaclung skills. 

2. ^To assist a child who is below grade levol in reading to improve 
his/her reading skills. 

3. To assist trainees in refining interactive teaching skills by pro- 
viding feedback on teaching performsnce. 

Thus far, you have completed one semester of work with a pupil; and 
have demonstrated some mastery over the problems of selecting appropriate ' 
instructional objectives and lesson planning. Work this semester will con- 
centrate on refining your interactive teaching skills. Interactive, teaching 
skills are those give and tak- transactions fmainly verbal) between teacher 
and pupil which are under tlie control of the teacher and geared to the 
accomplishment of specific instructional objectives. 

As you know, the major instructional objectives in this practicum are 
concerned with the teaching of reading. Achievement of the instructional 
goals for the pupi 1 requires first of all, careful analysis of the instruc- - 
tifnal task ana lien a construction of a plan of action for achieving the 
goals, A similar process takes place in determination and analysis of 
behavioral goals of teaching . 

Tne focus tins semester will shift from goal setting for the pupil to 
the setting of teacher behavioral goals. it is certain that your interactions 
vith the pupil will affect the pupils' responses, and over time should affect 
how the pupil learns. 

27^; " * ' 
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The Computer-Assiste d Teacher Training System fCATTSl 

The Teacher Education Laboratory in which you conduct the practicum is 
part of a unique Computer-Assisted Teacher Training System (CATTS) , designed " 
for the development and improvement of interactive teaching skills. 

The CATrS systc. wa-, developed at the Center for Innovation in Teaching 
the Handicapped (Clin), and it .s designed to provide real-time (instantaneous] 
feedback or delayed (post-teaching] feedback of information about teacher 
and pupil interactions. How feedback is used for the development of teaching 
skill will be discussed in detail in Section 2 of this Manual. 
Th e Role of Feedbac ^ n Skill Development " 
Development of teaching skill obviously requires the opportunity to 
practice. But as psychologists have consistently shown, practice alone is 
insufficient to a.sure the development of skills. For practice to be in- 
strumental in changing teaching behaviors in a desired direction, clearly 
articulated behavioral objectives for both teacher and pupil must be present. 
Another crucial variable in skill development is feedback on performance.^ Both 
pupils and teachers need feedback on their performance in order to modulate 
their teaching behavior/learning responses in terns of the lehavioral objec- 
tives. Thus, the three critical factors in skill development are: (1) clearly 

defined goals or ')ehavi or.-i 1 ohiori-i%fnc f-•^ X , ■ , 

_ vioj.li oDjettaves, f^) opportunity to practice, (3) feedback. 

n.e feedback teachers usually receivers from supervisors who often 

vary greatly in their degree of objectivity or in their preferences for 

focusing on one aspect of teaching or another. The CATTS system provides ■ 

a method of overcoming the subjectivity of supervision by providing feedback 

in the form of observation system data. The definitions of the categories 

of the. observation system are public to all so that the meaning of the 

feedback is the same for both trainee and supervisor. In addition, the 
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objective nature of the feedback makes self-evaluation an alternative to 
t ra di t i on a 1 s upe r vi s 1 on . 

The application of computer technology in teacher education is based 
upon a teacher tiaining model also developed at Cmi. The model should 
help you visuali/c how your teadiing experiences will be structured in this 
practicum course. 




Behaviors Patterns Environments 



Levels of Teacher Performance 



I-igure 1: CITH Teacher Training Model 

5 

^Semmel , M. I. Application of Systematic Classroom Observation to the- 
study of pupil -teacher interactions in Special Education, 1974. ^ 



21 



269 



Phases of Teacher Skill Dev elopnent- 

1. In developing teaching skills. ,ou obviously need to know what 
they are - you are able to dis.cr^inate instances of these skills when you 

seethe.. way of acquiring discrimination skills is by learning an . 

observation systcn which focuses on those teaching skills. 

2. The next phase is for you to tr>. out those teaching skills or 
^erat., the. i. .reaching situation. In this practicu. ,ou wil l have - 
nun^rous opportunities to practice specific teaching skills that you chose 



to work on. 



3. .n order to Know how -ell you have developed the given instructional 
skills a.d how to modify your performance to bring it closer to your 
Objectives, you need feedback for evaluation of performance. Rather th„ ' 
having son^one e,se evaluate your progress, you „ill have data upon which to 
evaluate yourself. Vou wi 1 1 be able to do this by usin, the objective 
Observation syste,. records that tra.ned observers have collected during the 
lessons you teach. 

■f.ll'!^^s_aj oim.;e_f or U ecision-Makin,. 

Feedback and evaluation information can also be used for an analysis 
Of you.p..iU.-s„e,f„r,once as well ,,s your own, and you can incorporate 
this source of i„fo™ati„„ to plan new behavioral goals and strategies for 
the next lesson. „,us, ,n addition to using feedback for developing inter- 
active t = adun« skuis, you c^ use the feedback data for instructional 
d ecision-making - e.g., lesson planning based upon pupil/teacher behaviors 
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that have actually taken place, Tliis information an^d analysis can become 
the basis fc. deciding how you will change and structure the interactive 
aspects of the next lesson. 

Leamins -Tt Observation Svstei? 

— . 

"n^G key to the implementation of the training model [Discriminate- 
Gene rate-Evaluate J and the development of interactive skills is knowledge 
of the categories of the observation system covering the domains of interest. 
This semester, the focuo is on p upil oral read ing. Ihis is the domain of 
intere<=t. You are already familiar with many of the terms and definitions 
involved in pupil oral reading and teacher prompting, through completion of 
Tips for T eacher Module 11: Prompting A Skill for Helping Children in Oral 
Reading (Brady, 1^)75). 

In order to interpret the feedback available through CATTS, you will 
need to become familiar with the terminology and definition of the Oral 
Reading Observation System (ORGS). You will need to be able to discriminate 
different instances of pupil miscues and teacher prompts or other behaviors 
that occur during oral reading, so that you can interpret feedback and. 
modify your own teaching behaviors. 

The plan for this semester is for you to spend at least six hours 
daring the first two weeks of the term mastering the Oral Reading Obser vation 
System. By the third week of the practicum, you will receive instruct! o:. 
on how to use the feedback avail.rble to you while you are teaching, and on 
how to analyze the feedback data in planning strategies for impit)veTrent of 
pupil oral reading, 

Hie next section of this manual contains the student version of the 
(OROS-S) Oral Reading Observation System (Lynch, Brady, Cohen, 1975). 

ERIC 
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Read the Manual before the first training session. Memorize the 
definition of each category a.d .ake note of any questions you have concen^ing 
the OROS, so th.t they can be discussed during the training sessions. 



27. 



Section 2. 
OROS Training Manual: Student Version 



ERIC 



274 



'ihe Oral Readirig Observation System (0R05) 
CnOS focuscii on teacher-pupil verbal interaction when pupils are read- 
ing aloud. Oral reading caji be used for a variety of objectives in the 
classroom: (1) diagnosis , (21 practice, (5) conimunication of infonnat ion , (4) 
instruction. Iv. the first three situations, there should be little or no 
teaclier interrupt i ens as the pupil reads. liov.cver, when oral reading is 
used to ineet instructional goals, the teacher assists the pupil to use his/her 
previous knowledge about words, word recognition rule-,jind context to 
figure out unknown words. 

Children often do not read stories word for word, even when the 
material is easy for them. .\ny pupil deviation from what is printed in th e 
st or\- is I ailed a mis cue . ;%hether the child substitutes one word for another, 
inserts a word iiito the text, omits a word, or stops reading entirely. 

Some miscue^ do not change the author's intended ineaninR ^ These mis cues 
occur because th(; elLiid is reading the way he speaks, using familiar words, 
or they occur because the child didn't know a word ajul substituted a similar 
one based upon in^ knowledge? of what kind of word should go where the unknown 
word was . 

Some misc ues change ti' ; ui thor's intended meaning and/or do not mak e 
se nse m the s entence, 'Ilie iniscues that change the meaning of the sentence 
are indicative of the pupil's failure to use cues or available information 
accurately in decoding the unknown word. It ; r:, in these instances that the 
pupil needs assistance. 

OROS can a^^swer the questfion, "VvTiat kinds of miscues do pupils make 
as they read orally?'^ One purpose of OROS is to describe the kinds of 
miser OS pupils makt* a? they read orally, 



275 



ERIC 



MaP.y teacher, require a child to road without niscues. even if the 
niscues do not change the meaning of what is read. Other teachers want the 
child to read fcr .caning and onl, .elp the child .hen his niscues change 
the meaning of the text being .ead. Tl^e fi.st approach can be called an 
exactness approach because the teacher requires the child to read each word 
exactly as printed. The second approach is a language-based approach be- 
cause the teacher believes that the child should read for n^aning using 
What s/he knows about language and reading, even if some words are changed. 
T^e second purpose of OROS is to distinguish between these two approaches 
to miscues. 

The third purpose of OROS is to classify how a teacher helps a cMld 
When a miscue is ,nade. Teacher responses to .iscues can fccus on .any 
different things, e.g.. telling the pupil to look at all or part ^ the 
unknown word, givn.g sound(s) of the word or saying "TT.afs wrong, try- 
harder." OROS data can be used to identify the worH ^» ^ 

iuenLir> tlie word recognition strategies 

a teacher is teaching her students to use. 

The fourth objective of OROS is to show how helpful the teacher's 
prompts are for the child, i.e., how often is a particular pron^t followed 
by a correct ansue,-7 OROS indicates how effective the teacher's strategies 
are for the Yo:n\v i . 

In conclusion, the purpose of OROS is to categorize pupil miscues. 
teacher respon.es to miscues. and pupil answers during oral readi.ig of 
stones. It can be used in any cl.ssroon, where a teacher has pupils read 
materials orally, regardless of the materials being red, as long as the 
teacher is using oral reading instructionally. It cnn be used at any grade 
level but will probably be most useful in those class.s where pupils have 
reading levels fvon, approximately the beginning of fi.st grade to the 
middle of the third gr^^^.^since it is at these reading levels that word 
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reccgnition is the focus in reading jlHS true t ion . 

Proirpting Liurin;; Oral R c a'd i : : g 

Ihe end gojl uf pror.;pting during oral reading instruction is no teacher 
prompting at all. Hiat is, the child has learned to recognize and apply the 
appropriate cue^ ic decode words or the meaning of tiie text and no longer 
needs nziy teacher help. The assu.--iption is that the techniques a teacher 
gets children to use for oral reading are effective in decoding words and 
meanings. An in^t ructionai module which teaches effective oral reading 
strategies was developed by Brady and Lv-r.ch (1975). Ihe module teaches the 
user to employ the ir.ost effective rrompts during oral reading instruction 
and also to use decision i.iles as a guide to chosing the "best" prompt to 
use in a given situation. Refer back to the module in planning your own 
oral reading stiaiL';ies. 

For 1 prompt to be effective, it must account for the lexical or graphic 
characteristics of -the word in the text, and the child's knowledge of read- 
ing. It is not enough for teachers to know what prompts to use, the teacher 
must also know how to decide whether or not a particular prompt is appropriate. 

C oding Teache r-ri;})i l_(Jral Reading Interaction 

ORGS js a classroom observation system called a categor>' system. Thot 
is, an obrerver records the occurrence of each category of behavior as it 
takes place durink; interactive oral reading. The obrerver using OROS 
distingui.^lies bcfueen discrete events (such miscues and prompts) and 
taDies the occurrence of each event into one cf the categories of OROS, 

Some interactions take very littl*? time, others extend over ■•'^latively 
long period, [iach imit coded on an 0R05 recora leprebents a single event 
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(e.g., a riscue,;. T>.e svstsr. i« -r.^ k--^..- • . . 

..... _a=eu, IS De.Tavicr based. 0ns 

code is nade per event, regardless of he- -.^^ >'r-« h 

^ -'^ e "as elapsed. Behaviors 

coded c.n CROS, :. i th the e.xceprion of ex...t re- i^n^ 

^ ^e>.:-!]n5, usually occur in 

rapid successioi;. 

IvTien observation i<; conolet^^H ncnt; • • ■ 

conj^iet.d. OR.jS Privices a record of the events 

Cxnteract.ons) th.t have c.urred du..ng o.al read..,, and the exact 
sequence xn whxch they occurred. 7T.e record ca. then be analyzed xn a 
variety of ways. 

Learning the PROS Categorie s 

Read. unde^,^. and 2j_e.orxze the na.es and defxnxtxons of each 
category xn the .yste.. It wxll ,xve vou the abxlxty to dxscrx.inate these 
behavxors when yuu see the., and wxll also enable you to use the coded 
infonnatxon abouc your o^ xnteractxons . lt..xll also be helpful for you 
to lear. to associate the code numbers for each category wxth the nane of 
the category, sxn.e the feedback on your lessons will be printed out in 
coded for.. However, you can always refer back to the .anual and ^u^nary 
sheet to interpret the feedback information you will receive. 

Figure 2 presents the maxn categories of ORGS in the typxcal sequence 

of evcnt.s as thcv ,.cnr .n an oral readxng actxvxty. Vou can see fro. 

Figure 2 .hat the.e are cxght n,ain categories (there xs a nxnth category. 

not shown, for n. s.e 1 1 ancous events that do not have anything to do with 

the oral readxng xtselfj. ,n the order xn which they usually occur, the 

categories are as follows: 
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1. Pupil Exact 
Oral Reading 




Miscjes 



3.4.5. Teachf^r Pror:pts 



Chai: ^'J 




or 



22 No I 



leanii:- 
Cl;ari L'^-' 
I'Misctie 




Pronpts 



Semantic 
leaning 
Proinj^ts 



Pupil 
Responds 



l-igure 2. Main Catcj^ories of ORGS 



7. Teacher 
Feedback 




Teacher 

Supplies 

Word 



ERLC 



28: 



279 



Table i sic^'-.-^-'-i pq-^^'-^^t-,-,;^^^^ 

- ...e ...a.. ..u..e.ories tne 0--0S. Although there are 

nine r^ain categorjcs in the ORGS, the f:o PUPL mts- e u 

, LUC . ..o Mib.,Jn subcategories are as 

essential to the <:v^r,^n • . 

...a. s>.t.n, a. ^ny or tne other nain categories and so 
are included in tl-.e sun-ar>- of nain categories. 



Code 
Number 



21 



3. 
4. 



7. 
8. 
9. 



Table 1. b 



unrar>- of Main CKOS C;>tegories. 



Category- 



J^upil Hxact Oral Reading. 

Pupil Miscuc: Pupil deviates from written text. 

Ihere are two types of pupil rescues: 

^!eaning change miscues. 

'>u -'waning diange nuscues. 
Teacher prompts on Graph i^ (written) features of word. 
Teacher pron^ts on Phonemic fsound) features of word. 
.Teacher prompts on Semantic caning) features of word. 
L^swersr'"'' '° teacher, (e.g.. correct, incorrec'^ 

Teacher gives feedback to pupil response. 
Teacher tells pupil the exact word. 
Beli,..joi:; not related to oral reading. 



M.-my of the .ajor categories in the syste. can be further divided into 
useful subcategories. 71,e expanded OROS which includes subcategories -and • 
definitions for each category and subcategory follows: 
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Oral Reading Cbsexvaticn Systen-S 
Definitions of Categories 



1 


E.xact Lrai Reading: 


Ihe pupil reads with no :v, scues. 


2 


r up 1 i .-il ^ cue . 


Ihe pjpil deviates from the text 
in sor^e nanner. 


21 


Nfcaning Change Mis cue: 



The miscue changes the meaning of 
the sentence , 




Meaning-niani;e > 


L s cue Subcategories : 


210 


N'o Res]>cnie Mitcjci' 


Tlie pupil does not atteinpt the 
word at all. 


211 


Let tci /Sy llab Je Mis cue : 


The pupil makes the sound for one 
or more letters or says one 
syllable of the word. 


212 


No Graphic Si ir^i 1 aii tv/ 
Low Grapliic Siniilarity 
Mi s cue : 


The word that the pupil substitutes 
r;as no more than two letters that 
are the same as letters in the 
text word. 


215 


High Craj^hic Similarity 
Mis cue : 


The word that the pupil substitutes 
has 3 or more letters same as 
letteis in text word. . 


215 


Insert i on /Oini ss ion 


Hie pupil omits a word which is in 
the text or inserts a word into 
the text. 



2S1 



22 


■ :*o .'.earning Chzmge Miscue 


T.\Q ":.?cue dees r.ot substantially 
chrncv -];e reining of the senterce. 




r.L Meaning Change 


Mi 5 cue Subcategories 


222 


No Graphic Similarity 
Ml 5 cue : 

• 


The vord the pupil substitutes is 
very different than text word (no 
-ore than 2 letters the sair^3,but 
tne new word does not change the 
Che meaning of the sentence. 


2.1 3 


High (;ra];l)ic Sinilarity 
Mi s cue : 


The word that pupil substitutes is 
ver>' much like the text word (3 or 
r-ore letters the same) the sub- 
stitution does not change the mean- 
ing of the sentence. 




Cos e /'] e J J e / P roi i u:i c i a 1 1 on 
Mi 5 cue : 


Tlie niscue changes the case or 
tense or is a dialect pronunciation 
v;hich does not char.::' r.eaning cf 
tiie sentence. 


225 

j 

1 

\ 


Insertion/Omission : 


Tnc pupil omits a word ^which is in 
the text or inserts a word into 
the text tliat does not change the 
meaning of the sen*-ence. 



I 
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Teacher Pronpts (3, 4, 53 



Graphic (Visual) Prompts 
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42 



43 



44 



45 



Teacher prompts on the graphic 
features (letter, syllable, 
structui-ej of the word. 



31 ' Letter Name: 

32 Spel lin^ : 

33 Structural: 

34 Attention: 



Subcategories 



Teacher names or asks for a letter(s), 
consonant blends, digraphs, within 
the word. 

Teacher spells or asks the child 
to spel 1 the w.ord. 

Teacher telZs pupil, or asks pupil 
to identify syllables in the word. 

Teacher focuses the child^s visual 
attention on word. ("Look at it"]) 



Phonemic (Sound) Prompts; 



Teacher prompts on the sound 
features (consonants, stress, 
patterns, phonic role) of word. 



Subcategories 



Isolated Sound : 



Sound Out : 



Unnatural Stress; 



Pattern : 



Phonics : 



Teacher gives or asks pupil to make 
the sound for letter (also digraphs 
and blends) in the text word. 

Teacher sounds out the word letter 
by letter or asks the pupil to do so, 

Teacher gives unnatural stress to 
one consonant (or blend or digraph) 
and then says the rest of the word 
in a natural manner. 

Teacher- asks pupil for, or gives 
pupil a rhyme or word family clue 
to text word. 

Teacher asks for or tells a rule 
concerning the letter/sound re- 
lationship in a word. 
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5 


Word ProiTipts : 


Teacher uses semantic features of 
word or sentence to aid in identifica- 
tion of word. 


5i 


Word Meaning : 


Teacher gives or asks pupil for 
r.eaning/ definition/association of 
word. 


S2 


Context : 


Teacher uses information in the 
sentence or stor>- to cue pupil 
about the text word. 


6 


Pupil Response 


61 


Incorrect Answer/Word: 


Pupil incorrectly answers the 
teacher's prompt, or fails to give 
an answer. 


62 

> 


C^.-rect .*\nswer: 


Pupil responds correctly to prompt 
but still docs not get the text 
word. 


63 


Self Cui rect : 


Pupil rereads and corrects own 
miscue without any help or prompting. 


64 


Exact Word/Ko Meaning 
Change : 


Pupil gives exact text word after 
teacher prompt, or responds with a 
vord that does not change meaning of 
the sentence. 


65 


Other I'upi 1 Answers : 


In group instruction, a non-target 
pupil responds to teacher prompt. 


7 


Teacher f-eedback ( 7 J 


71 


Positive Feedback/ 
Hncouragcment : 


Teacher praises the pupil and en- 
courages attempts to respond. 


11 


Negative Feedback : 


Teacher tells pupil that miscue or 
answer is incorrect. 


73 
74 


Management : 
Other Piipil: 

-Sio 


Teacher gives pupil general directions 
about reading, e.g., read slowly, 
start again, repeat, use expression, 
read carefully, etc. 

In group instruction, teacher calls 
on non-target pupil for answer to 
prompt . 
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Other Categories 


8 


Teacher Telling: 


Teacher tells the pupil the text 






word, using natural pronunciation- 


9 


Non -Oral Re adi n g : 


Teacher, pupil (s) are not talking 






about oral reading or word re- 






cognition (e.g., change to com- 






prehension discussion during oral 






reading) . 
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Reliability of URQS Data 

A coder is a person who has lean^ed an observation systen, ai^d who can 
code different instances of teacher/pupil interaction with a high degree 
of reliability. Coder Reliability is establishod by testing coders against 
a known criterion (i.e.. a video tape of interaction that has been pre- 
coded by an expert). Good coders must also be consistent and so are also 
tested twice over the sa;^ materials to determine if they code the sa;ne 
way when viewing the same interactions at different times. 

me coders who are observing your lessons have all tested at .80 or 
better on both measures of reliability. 

•mus, even though there is some degree of error associated with the 
collection of observation data, the.data you will be working with is 
accurate enough to give you useful information for interpreting pupil and 
teacher behaviors. 

Collecting Data and Coding PROS 

1. Wlien a pupil begins oral reading, the coder records a [Tj . As 
icng as the pupil continues to read without miscues there are no 
additional codes made. 

2. As soon :.s there is a pupii miscue, the coder records it (e.g.. 210). 
then records what happens next. Usually a teacher prompt (e.g.. 34) 
follows the pupil miscue. Next the pupil responds (e.g.. 64) to the 
teacher'spronipt. and often the pupil resumes exact oral reading. 

3. As soon as the pupil resumes exact -xal reading after a mis cue -prompt 
interaction, the coder records a QJ 
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Exanples of coded Oral Reading Inceractions : 

*Ca) 100 215 340 €40 IDO 

(b) 100 222 6:S0 IDO 

(c) 100 210 340 610 SCO 640 H:! 

Example 1. In line (a}, we see tlie codes for a single teacher-pupil 
oral reading interaction. Initially, the pupil read with no miscues (100), 
then the pupil miscued, substituting a word that looked very mich like the 
target word, but v.hose meaning was quite different (2153- The teacher asked 
the pupil to look at the target word again (attention proinpt , 540), 

In vhis case calling the pupil's attention to the word was all that 
was needed, for the pupil responded with the correct word (640) and con- 
tinued exact oral reading (100). 

Exercise 1. Using the OROS definitions as your guide, interpret the 
interactions in examples b and c. Write the description of the inter- 
actions below, 

b. 



c. 



*A11 categories will be giiven in 3 digit form since that is how coded informa- 
tion is printed out* by the computer, eg,, category one reads 100, category 
Q 63 reads 630, etc. On 
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Exercise 1. Discrimnating between rcanirig-change (21). 

Miscues and no-meaning change nsiscues (22). 

-nie following sentences were read by a pnpil. Miscued words are 
underlined. M.at the child did with the word is sho..n above the nuscued 
word. Garret A indicates an insertion. 

Enter the correct code. 21 or 22. in the box next to the mscue. 

1. The trucks coine ( (down the highway Hj. 

was supper 

2. There were j | two people for dinner | | . 

hungry^ uhm. . , . 

3. Many woke up happy | | because it was her birthday F]. 

for 

4. They caine to tlie city from [_] the country. 

V brought 

5. She bought f_J peanuts, 

carried 

6. He carries \~] the ball. 

^'^^^G 1— I which 

7. The trucks c ome | j over the land with | | food. 



crows 



8. Milk comes froni cows [~]. 

was ^ ^ who^ ^ Away ^ 

9. Tom saw the boy a □ run. /\ Q 

10. Jim walked ar .^'.nd Q the town | [ square. 
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Types of pupil niscues (niscue subcategories) 

As shown bfeicw, the basic pupil niscue subcategories car. be further 
subdivided to describe the nature of the pupil niscue. Refer to the 
•definitions cn pages 7 and S to comlete exercise 2. 

Pupil Miscue Subcategories 



21 Meanirg Cliange 


22 No Meaning Change 


210 No response 

211 Letter, syllable 

212 No similarity 

213 High similarity. 

215 insert ion/ omission 


222 No similarity 

223 High similarity 

224 Case/Tense/PronuTiicatioii 

225 Insertion ^o.r'S5i!:m 



Exercise 2. Coding types of Pupil Miscues. 

Hnter the code in the space next t o 

miscue is shown above the word. \\: 
a A , omission by 



truck 



comes 



The trucks |[ ] come | | down the long highway 



wc :ra Ihe pupi . 
I 'M\s ax'ii. shouT by 



eujiie 



The trucks conic | | down | | the long highway | 



uhm. . . 
he trucks [73]* 

iohnny stop 

4. .. ohn I I stopped | | his horire. 

bird were sing ing the ^ word 

5. "he birds j | sung [ | by a | | window [ | . 

birk-uh i^^^^i -Sailed^ uhm... 

6. The birds | | | [ sung | | by a window | | . 



EKLC 



lUim. . . > . . » . . . 
Mary | | > 

uhm. . » » » . . . 
Mary woke | H up happy. 
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"On't know th e word. 



10. 



WLLi, c, ku.h 
Mary woke QI] up liappy " pn^ 

tX^^'"^'^^ d-duh-duh ku.h-kuh-5-nuh 

^""^^^"^"^ i I IS 'iark □ in the corrier r~i 



Check pjiswers on page 30. 
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Teacher Proinpts: Categories 5, 4, and 5. 



Categorv' 3. Graphic (Visual] Frorpts 



Cate.::..rv ^ r;;, i^i sts of prorrpts .iv call tiie pupi : 's attention to the 
written featur- ^ >t • le word. By ajin so, the teacher requires th^- pupil 
to look 2it z\vt wcrjl or seme part of i Tiiese prompts supply visual cues 
and thus deper.d upc -he pupil's vL-uil skill (e.^, , vii-^ual discrimination, 
K^K.OTy , recu^ ,iou, ..requencing) . 



Categc*^ Graphic Prompt Su:: jgories 

J N.jnes, letters, cnns -iuint blends, digraphs 
Spoils word 
33 :Jontifics syllabi ithin wore: 
3-1 '::cr.tion focuscc ,.ord 



Exercise 3. In the following cxairples, the sentence read is shown in 
all capital letters. Mow the pupil read the sentence 
is shown following the letter "P." The teacher's pronpts 
lire preceded by the letter "T. " Give pupil and teacher 
CLides. Use the one codes to show exact oral reading. 

1. FRED WAS A BOY ■.;!I0 LOVED SEALS. 

P: Trod saw [ ja boy who loved seals. 

T: Ired i>aw? j | . 

2. TIIHY COULD NOT STAY AT THE ZOO FOR THE AFTERNOON. 

P: They | | cuuld not stay at the zoo for the after [ | . 

That's a compound word. WTiat is the second word in it? | | . 
Noon . 

Now put it together [ j. , 

2a; 
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3. BUi NO ONE CAME TO BUY A SEAL. 

P: But Q no one cair« to put j j. . . . 

T: It begins with a i; | j . 

4. Ml AT DID I SAY? 

P: IVent. . .•,;aiit Qdid I say. 

T: IVhat's the word before did? Q 

5. IHAT A.N'GEL ILAD SOME BUMP! 

^- "^st I j ^igel had some dump 

T: Do you see a d on the beginning of the last word? Q 

6. COME A,\'OTHER TIME. SHE SAID. 
P : Come an ... . j J. 

T: Do you ^co two words there? IvTiat is the first one? Q 

7. TTiEY BOTIl WENT ON TIIEIR WAY. 

P: They Qj both went on their may Q. 

T: niat last word doesn't start with m. What does it start with? 
3. TTfEY STOPPED TO LOOK. 

P= ■'■''•^y [ ] stopped to cook Q. 

T: Stopped to cook? Point to that word Q 

9. A FRIGHTENED VOICE CALLED TO IHEM. 

P: A □ frightened □voice □ called to them. 
T: F-r on the beginning of the word Q. 
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10. FRED PUT A BIGGER SlQi OUT. 

P: Fred ( [ put a buh... | ! . 

T: Cover the g-e-r. What's that | j? 

?: Big. 

T: Rigb.t, no\. add the g-e-r j j. 



Check answers on page 30. 
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Categor:,- -1. Fhone-ic (Sound) Pro-uts. 



Gate go r>- 4 includes all these p- 
These 



^a^ts which give sound-letter correspondences 



prorrpts supply auditOT>- cues and depend heavilv 



s5<^ill5 (e.g., discrininaticn 



y upon the pupil's auditory 



. recognition, rr.enor>-, etc.) 



Categoi^- 4: Phoneme Prcippt S.-bcategories 

41 Isolated Sounds 

'12 Sound Out Word 

13 iinnatural Stress 

44 Pattern (IVofd Family) 

45 Phonic Rules 



> Check your answers on page ^ piu 

1- ...A\D A BI'jE OJ' SUPPER. 

P: And [□ a bit Q of supper. 
T: Is that l_ long or short? j | 



2. 



ivIIEN HE GREW UP. 

P: IVhen Q he uJim. . . 

'J'- l^liat is tl)is word? (writes NEIV) | | . 



Now 



I'm going to remove the n and v^rite g-r. IVhat is it now? Q 



3. TMEY COULD NUT STAY AT THE ZOO. 
^' They | ( could not sit Q 

T: Not sit, listen, stuh a. What is it? Q 

4. KATE WAS LOOKING AT JOIL\'. 
P: Linda Q 

T: It- starts with ' Kuh- so it wouldn't be Linda Q 



5. A LOT or SNOIV FULL QUICKLY. 

P: A.[]^ lot of snow fell uhm | | . 

T: Tlie q-u says kwih. | { 

6. WATCH niO ROAP. 

P: Watch tlic ulim. ... | |. 
T: Rhymes with bad | | . 

7. niO BRIGHT SUN SHONE. 

P: The brut [ | sun shone. 

T: Not brut, say bruli-t-tuli | [ 

8. THEY WENT ON TO SEV^JNTH STREET. 

P* 'Hiey [ [ went on to Sss. . . . | | . 

T: s-e-v-e-n-t-h. How do you sound that out? | | 

P: Suh-e-vuli-e-nuh-thuh. 

T: Now put it together | | . 

9. THEY GOT ON THE Tf^lN. 

P: . They got on the truck | | . ' 

T: Not truck. It has tie same beginning sound as truck 

10. ..SHE CAMi; BACK JUST NOW. 

P: She I I came back iinih. , . *" ' 

Make the j soimd | | . 
Juh 



T 



JuJi-ust, jidi-ust. Put them together | [ 
Check answers on page 30. 



Category 5. Word Prompts, 



'■re are two types of word prompts used by the teacher: WORD MEANING 
PROMPTS (51), and CONTEXT PROMPTS (52). 



51 WD MEANING: Teacher gives or asU. p„pU f„r the definition. 



52 CONTEXT: 



meaning or association (s>^onym and antonymn of the 

Teacher uses information in the sentence or story 
to cue pupil about the text word. 



Exercise 5. 

1. KEEP YOUR EYES OPEN FOR EMPTY BOTTLES. 
yP: Keep your eyes open for uhm | [ 

T: If .the bottle isn't- full, then it's... Q 

2. HE WAS SHOVELING SNOW. 
H: He □ was ... Q 

Skip that word and go on | | . 
Snow. 

lie was blajik snow. What mi^-ht it be Q. 

3. FRED WAS A BOY WHO LOVED SEALS. 

P: Fred □ saw £J a boy who lived [J] seals. 
, T: Did that make sense? ^3 

4. TTIE BOY SQUIRTED WATER AT HIM. 

oy splashed | | . 
T: =TIiat w^rd means almost the same as splash 

302 



KEN WALKED OUT OF TIIE ROOM. 
P: Ken Qwali. . . | |, 

Say blank ajid go on [ | . 
Out of the room. 

Ken blank out of the room. Wiat word fits in? [ [ , 



Check answers on page 31. 
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Categoiy 6. Pupil Responses. 



•mere are five subcategories within the pupil response category. 
Three of these always occur in response to a teacher prompt; they are 
Incorrect Answer (bl). Correct Answer (62). Exact Word (64). Category 63 
(Self-Correct) is used when pupil corrects his iniscue with no help. 
Category 6S is used in coding group instruction and is used when some 
pupil other than the target pupil responds to the teacher prompt. 



Category 6. Pupil Response Subcategories 

61 ^Incorrect Answer or Word/Fails to Ajiswer 

62 Correct ^\nswer 

63 Self -Correct 

6'l Exact Word or No Meaning Qiange Miscue 

65 Non -Target Pupil Answers 



Exercise (). 
1. HIS TEACHER TAUGHT HIM MUSIC. 

P: His ubm [3 

What's a word for a person who teaches? 



Ul,m....[2] 

I ajn your wliat? | | 
Teacher [ [ . 



2. HE LOOKS LIKE A WILDNL^X'. 

He looks like awhu.... | | . r 
It has two little words. What's the first one? Q 



Wild Q 

You know the second word, put them together | '] . 
Wildman [""j "i " 
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3. HC LOOKS LIKI: A WILDMAN. 

P: He looked { | like a woodman, 



-Check answers on 



paye 
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Category 7. Teacher Feedback and Management 



The behaviors in this category include general teacher feedback and 
management related to the oral reading task? There are four subcategories : 



Category Teacher Feedback and Management ^./ ^ egories 

I o'jitive Feedback/Encouragement 

'2 -gative Feedback 

73 Management 

74 Turns to Another Pupil 



Examples of Category 71 

1. "Very good** 

2^ *'Say it»» 

3. **You alniu,st had it*' 

4. ^'Alright , very good" 

5. "That right. It's should" 

Examples of Category 72 

1. "No" ' 

2. "Not should" 

3. "That word's not find" 

4. "You got the third word wrong" 

5. "Tlie word after school isn't pnrty" 

Ex'j.iples of Category 75 , 
1. "-.Oiat are you saying?" ' 

5: 'st^i'^rpagT'tU'"' ■i'^e talking... 

'Z^z. ':::zric\^t.r'' -^"^ 

5. "Read louder." 

Examples of Category 74 (used in group instruction) 

1. VDoes anyone know that word?" 

2. "Joe, ciin you help him out?" 

3. "Can anyone tell me what w~h-e-n spells'^'* 

4. "Mary, tell Jane that word." 

30^ 



Exercise 7, 
1. "MAYBE I WOULD/' SAID ALBERTA. 
P: Uhm lZ|. 

T: "It's 2 words together | |/' 
P: "Might I 

T: "No not mi^ht | |." 
P: iSlm I | . 

T: "We're riglit here now go aJiead and read [~[ '' 
P: "May be | [ i would said Alberta." 

T: "Go back and read that again but this time take the pencil out of 
your mouth f [ /' 



2. "WELL," SAID WALKIiR. 
P: 'nVhen Q"]." 

"No, try it again. | [ ' 
"Where | |. " 
"Not w-h, w-e I ^|." 
"Wuli-6h I | ." 

"That's ri gilt so far, keep going | |. " 



Check answers on page 31. 
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Uitegcr'- •;. ii richer Telling 



^ '-teir.>iy teacher tells pupil the word u.ing natur.. pronunciation, 

ing. 



Tliere- r- no • .bca- fgories to teacher tell 



Cata'gory jii-Oral Reading 



Teacher or .n,nl switches from oral reading to ta_k ^^om .....thing 
else. For ex -.pi. , pupil begins to talk about a persc^.' e.xpe , ce. 
Teacher switches asking coniprehension questions. T •„ - ar. .0 sub- 
categories in -.'twi; classification. 

, Exercise 8. 

1. 'im uCg is brown. 

P: "Hie Q]]] do^; is brown. Mrs. Jones, T b r < 1 i „ 

T: •'Timmie. you're not paying attention. ep reading 

2. im WAVES SWLPT HIM OUT TO SI-A. 

P: "Tlie I I waves um P~l-" 

T: "lhat word is swept | j ." 

P: "Swept Q_J him Q out to sea." 

3. 75 IE STORES AUE CLOSED. 



P 
T 
P 
T 
P 
T 



"Tiie 



"Cover tifste s. IVhat is that much j [?." 
"Sorry ( ]." 

"Store. [_J Now add your s (~]. " 
"Stores I |." 

"l\1iy do yom think the stores are closed | j?" 

30P 



P: ''It was late at night/* 

T: "How do you know that?" 

P: "Because the streets were quiet." 

T: "Right. Now continue reading I j 



Check answers on page 31. ' 



Answers 

Exercise 1 page 14. 

b. 100, no miscues, 222, miscnv, ,0 mc 
like the target word, 630, :,u il s- 
prompt, 100 pupil contitu - 

^- 100, exact oral readiii) „ ^ ; 

asks pupil to look at i; . p„p, 
80i: , teacher tells pupil the- word, 
and continues 100, exact oral readi- 

Exercise 1, page 14. . 



■ P wo, ;1 (i(V-. look 

■ " was ■ -.c ^-inchc- 
■epeat;; t\n\ . oxc cr-rrecrly 



1. 


22, 


21 


2. 


22. 


22 


3. 


21. 


■21 


4. 


21 




5. 


51 




6. 


22 




7. 




21 


8. 


21 




9. 


21. 


21. 21 


10. 


22. 


22 



Exercise 3, page 17. 



1. 


213., 


340 






2. 


100. 


213, 


350, 


330 


3. 


100. 


212, 


310 




4. 


213. 


340 






S. 


100. 


213, 


MO 




6. 


212, 


330 






7. 


100, 


213, 


310 




8. 


ICO, 


213, 


340 




9. 


lUO, 


213, 


100, 


310 


10. 


100, 


211. 


330, 


330 



1- , 



\>::-^e IS. 



10 



) ^ — , i 



^- -l-T, 212, 2.12, 21(j 

8 2i;: 

21 . 210 

10. 21 1 21 I , 211 

xercise 4, page 19. 

1- 100, 222, 450 

2. 100, 210, 440, 440 

3- 100, 212, 430 

4. 212, 410 

5. 100, 210, 410 

6. 100, 210. 440 

7. 213. 430 

8- 100. 211, 420. 420 

9- 100. 212. 450 ' 
10. 100. 210. 410, 430 
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Exercise 






1. 








2. 


m 




. 520 


3. 


1 




5.10 


4. 


K , 


222 , ' 




5. 




211 ! 


, 520 



xercise 6, p:v»e I-l. 

1. 210. 510, 610, 510, 620 

2. 211, 330, o20, 330, 640 

3. ' 224, 213, 6 30 • 



Exorcise 7 . p;ii;e 2b. 

1. 210, 330, b; 
750, 640, 7,- 

2. 2i: - 61, 

710 



720, 610, 
310, 610, 



■ rcise 8, page 28. 



1. 100, 900, 730 

■2. 100, 210, 800, 640, 100 

100, 210, ViO. 610, 800, 330, 

640, 900, 7.:!0 
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Trainee Manual II 

Developing Teaching Skills: Prompting 
Strategies for Oral Reading Improvement 

The objectives of this manual are as follows: 

1,. To introduce the CATTS and audio tape feedback systems (page ) 

2. To discuss the reasons for developing prompting skills (page ) 

3. To provide you with instructions on how to interpret CATTS 
printout (page ). 

4. To set individual skill development goals (page ).* 

Also included in the manual is a key to reading the printout, found 
on page • . 
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Introduction to the ComputeT-Assisted 
Teacher Training System (CATTS) 

The CATTS system of teacher training is designed to provide the teacher 
trainee with objective infomation about his/her individual patteiTi or use 
of different teaching strategies during a given lesson. The system uses 
trained classroom observers to code lessons. The data they obtain is trans- 
mitted to the computer in "real time" (as soon as it is mechanically punched 
in on the button-box). The computer then transmits the information obtained 
from the coder into a data storage file for latter use or it analyzes the 
data and feeds it back to the teacher - also in "real time." (See Figure 1). 

In the present use of CATTS, we shall use the computer to perform both 
these functions. The data that is stored will be retrieved .^,d printed out 
so that each teacher can review it and have an objective picture of his/her 
individual use of different teaching strategies (represented by each-of the 
categories on the Oral Reading Observation System). In addition to print- 
out data, teachers will have the opportunity to have some of this data fed- 
back into the- classroom during teaching. This "instant" feedback is in the 
form of a moving graph displayed on a video monitor in the classroom. 
Additional detail on how the video feedback works and how you work with it 
will be presented in a handout; 

CATTS and Audio Tape Feedback 
Since the feedback capacity of our equipment is limited, we can provide • 
computer feedback to only ten tutors at a time. As an alternative, we have 
arranged for audio tapes of the oral reading lessons to be provided for the 
ten tutors who do not get CATTS feedback. Audio tape playback is a good 
source of infoimation on how you are teaching and teaching goals will be the 

X, 3U 




Figure 1. Arrangement of Laboratory Classroom for CATTS. 
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saae for everyone. After three lessons, tutors getting CATTS feedback will 
switch to audio tape feedback, audio feedback tutors will get CATTS. We will 
make four such changes during the semester so ever>'one will have equal 
opportunity to get both CATTS and audio tape playback. 

tVhy develo p prompting skills? A theor>--based explanation for the 
use of prompting strategies. The development of teaching skill depends on a 
number of factors; fir.t you must know ^ a particular strategy is important 
or preferrable to an alternative way of teaching., then you must practice and 
become skilled at using the strategies. The CATTS system of teacher training 
has been developed so that you focus in on selected teaching strategies and 
develop the skills in using them. However, skill in using the different 
strategies is not enough, you need to know the principles that underlie the 
use of specific skills so that you can decide when to use them in different 
situations. 

Principles underlying th e use of specific teacher promp ts . 
As you know from learning the Oral Reading Observaticn System, there are 
many ways of prompting the various types of pupil miscues. If you refer back 
to the module on oral reading that you worked through last semester, you will 
see that, not all prompts that a teacher can use should be used. .That is, 
the module recommends use of five specific prompts. and also describes those 
prompts that should not be used. In addition, recommendations about when to 
prompt and when not to prompt are mdde. as well as how long any prompting 
sequence should last. All of these recommendations are based upon assumptions 
about how children learn to read, how teachers can assist pupils in acquiring 
good reading skills and how pupil deficiences and disfunctional reading 
strategies can be remediated. 
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The prompting strategies recomended in the nodule are based on the 
theory that a child must be able to use multiple sources of information if 
he/she is to learn to read. The child must first understand that reading 
is a written (coded) form of the spoken language in which he/she is already 
quite competent, and that the same implicit rules that govern the pupil's 
use of language for oral communication, govern the use of written communica- 
tion. That is, a written sentence is always governed by the same semantic 
(meaning) and syntatical (grammar) constraints as is the same sentence in 
spoken form. The linguistic (meaning and grammatical) constraints and cues 
are the most important sources of information available to the pupil. In 
terms of teaching, these are the context prompts (52 's) used by the teacher. 

Pupils whose miscues indicate that they are using their understanding 
of language to figure out what the sentence is "saying'^ (i.e., miscues that 
do not change the meaning of the sentence) are using context as their major 
source of information in decoding the written text. It follows therefore, 
that the teacher must not discourage tho pupils use of context by prompting 
or calling attention to miscues that do not change the intended meaning of 
the sentence. 

It is most important that you learn to prompt only meaning-change 
(21) miscues, and avoid prompting no-meaning-change (22) miscues. 

Given that the pupil must learn to use multiple sources of information 
in learning to read, what other sources (in addition to context) are 
important? Basically there are two other sources of information: (1) 
letter-sound correspondences and (2) word structure rules. Unlike context 
cues which depend upon the child's knowledge of language and which the child 

317 
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is presumed to have, the latter two skills r.ust be taught directly (but 
not during oral readi-.gl). In order for these prompts to work, the pupil 
must have acquired some level of knowledge of letter-sound correspondences 
and word structure rules. 

Clues supplied by the teacher in the form of prompts (3, 4, or 5 codes) 
are used by the pupil to either figure out the exact word outright, or to 
form a tentative, mental hypothesis about what the target word is-which is 
then "tried out" against the context information. 

In short, there are important reasons for you to prompt, and a few 
principles to follow that will tell you why and when to prompt. 

•1. By prompting only those miscues that clange the meaning of the 
sentence, you help a child to learn that reading is a form of com- 
munication, 

2. .By using a variety of prompts you help a kild discover that there 
are several kinds of information that can be us\d in figuring out a 
word. 

Which Prompts to Use? If you review the Prompting ^todule you received 
last semester, you will recall that there are^ f ive prompj^s that are 
recommended : 

Context prompt (52) - 
Structural prompt (33) 
Pattern prompt (44) 
Phonics prompt (45) 
Attention prompt (54) 

Through practice you can become skilled in using each of thes^ "strategic" 

prompts. You use these prompts because they help a child leaAi a variety of 

decoding approaches and because they are more apt to lead to sutcess in 

figuring out a word than other types of clues or prompts 
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The next section takes you through the interpretation of the informa- 
tion on the prompting strategies you used last semester, and how this 
information can be used to set new teaching goals. 
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Interpreting the Printout Simnar\' 



The printout sunnary of each oral reading lesson is filled with inforaa- 
tion for you to use in analyzing your own teaching style and your pupil's 
oral reading patterns. The data on your teaching can be used for self- 
supervision, interpretation of what took place during the lesson, and use 
of the information for planning new teaching strategies. 



Read the description of the data available in the printout and then 
complete the graphs and behavioral interpretations as indicated. (Except 
where indicated all graphs should be line 'graphs) . 



ITEM 1. TOTAL OBSERVATION TIME: 

The amount of time you and your pupil actually spent on oral reading 
during the observed lesson is the first item of information presented. 



Construct histogram (bar graph) by entering the number of 
on each lesson 
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Interpreting the graph . The average lesson should be between ten and 
fifteen ninutes long. On the average, how nuch time did you spend per 
lesson, on oral reading? Were you consistent? Were the lessons too long, 
too short, too variable, just about right? 

Decide if any changes are desirable and what direction changes should 
take if they are needed, and complete the goal statements below. Take into 
account the attention span of your pupil in making your decision about 
necessary aditiStments in the amount of time you spend on each oral reading 
lesson. 

OBJECTIVES FOR TIME SPLNT ON ORAL READING (check as appropriate). 

--M>' oral reading lessons should average about | j minutes each. 

--Amount of time spent should be maintained at the same level as 
first semester | | - 

--Amount of time should be increased | | • 

--Amount of time should be decreased | | • 

--Amount of time should be stabilized | ] . 



ITEM 2. TOTAL WORDS READ: 

During the first semester, word count records for lessons conducted are 
not complete. If your printout for any one lesson does not have a word 
count for number of words read, go back to your files and determine what was 
read and enter the word count for that lesson in the space provided on print 
out. 
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Vhat infomaticn do you have about the length of the passages you have 
chosen for oral reading over the first 10 lessons? 
Lowest number of words read 
Highest number of words read 
Average nuinber of words read 



Consistent across all lessons? ves 



no 



Complete the Goal Statement: 



New goals for second semester 

Increase passage to approximate words per lesson. [_ J 

Decrease passages to approximate words per lesson. | } 

Reduce varability over lessons. 



Data shows adequate, consistent pattern, no changes indicated F 



_ 



ITEM 3. PUPIL MISCUES TOTAL 

Find PERCEJT MISCUES TOTAL. This figure indicates the percent of pupil 
miscues in relation to the total number of words read. The figure in -ates 
the difficulty level of the passage read. 

If you have reason to believe that the difficulty level of the' passages 
you selected for oral reading are consistent, then the trends in the pupil 
oral reading miscue data can be also attributed to change (improvement) in 
the pupil's oral reading. 
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GR.-PH THE TOTAL PUPIL MISCUES (PERCENTAGES) CCCURP^D OVER TliE FIR5T SE?'£STER 
A.ND DEVELOP SC.^E TENTATIVE iriTOrriESES ABOLrT WliAT THE DATA SHOWS: 
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If no clear trer.d einer^es, or you have reason to believe that other 
factors are operating, then this data nay not be useful for pupil evaluation. 
It can tell you however, about the difficulty level of the materials you 
choose . 



Does the data suggest change in the difficulty level of the materials? 

Too easy (few niscues} yes no (less than 10%) 

Too hard yes no (nore than 20%) 

About right yes no [about 10%) 



ITEM 4, TEACHER RESPONSE TO PUPIL MISCUES: 

This tells how many (frequency column) and what percent of all pupil 
miscues were responded to with some t>pe of prompt, feedback, or direct 
telling .by the tutor. Interpretation of thii data is optional 

ITEMS. MEANING CHANGE MISCUES [21 's): 

These are the pupil miscues that constitute real reading errors and 
pupils should be provided with cues and ^^trategies for overcoming these 
errors if their oral reading is to improve. Hie pr?rcent?iige figure shown is 
the percent of meaning change in relation to al^ miscues. (Pupil miscues 
followed by pupil self correction (63's) are not counted in the miscue 
total). 

ITEM 7.' NO-NE/\NING CHANGE MISCUES: 

These miscues show that the pupil is correctly processing the meaning 
of the passage even if the encoding is not precise. 
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Track the relaticnship between iio-nearjrg change (22), and meaning 
change (21) riscues by entering the percentages for each categor>' on the 
same graph. Overtirie, an improved reader 3hould show relatively fewer 
neaning change miscues than no-meaning change niscu.es. (ITEMS 5 and 7) 
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Information in this grapli can be interpreted in a namber of ways and inter- 
pretation is optional. 
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ITEM 6. TEACHER RESPONSE TO PUPIL MEA}iISG CrJC^GE MISCUES: 

The data in this line tells how r.any reaning change niscues were 
followed by a teacher proript or other response. 

ITEM 8. TEACHER RESPONSE TO XO-ME.i.STNG QiWGE MTSCUES: 

As in iten 6, the data here shows the nuniber and percent of pupil 
22 's that the tutor resDonded to. 



32 



320 



Teacher behavior should play a vital role in pupil oral reading isprove- 
laent. Are no-r?eaning change (22 'sj being pronpted? Lingmstic processing 
theory of reading suggests that a good teacher should aim J'or the reduc- 
tion of prompts of no-neaning change miscues, but that meaning change (21) 
miscues should be prompted. 

TRACE THE PATTERN OP TEACHER PROMPTING OVER THE FIRST SEMESTER BY 
GRAPHING 21 .AND 22 's PROMPTED. INTERPRET THE BEHAVIOR SHOWN BY THE RELATION- 
SHIP BETWEEN THE WO LINES aIJD STATE THE TLi.anNG BEHAVIOR COALS (CHANGES) 
PATTER-N'S SUGGEST. (ITEMS 6 and 8) 




1 2 3 4,5 6 7 

4. Comparison of tutor prompting of 21 and 22. 
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INTEPPRETATI 




--Is the percentage of responses to 21 's r:uch greater than to 22 's? 
yes no 


—Are all 21 's being prompted? yes no (Anv percentage less ^han 
100 indicates that some 21' s are not being prompted.) 


--Is t'lere great variability between lessons? yes no 


Taking all 


these factors into account, the most reasonable change goals 


are: (1) 


Increase Prompting of 21 's 


(2) 


Maintaining same Level of 21 's Prompted 


(3) 


Decrease Prompting of 22 


(4) 


Maintain same Level of 22' s Prompted 



ITEM 9. PUPIL SELF CORRECT: 

This line shows the frequency of pupil self corrects (63) and percent 
of (63's) relation to alj^ pupil miscues (21 and 22). This data can be a 



good indicator of pupil oral reading improvement over time. A child who 
has developed new and better oral reading skills should show more self 
correction of miscues. 
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Graph pupils' self-corrections of miscues and interpret .* (ITEM 9) 
40 
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Pupil 20 r-" — 

Self ^ 

Correction 
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1 2 3 4 5 6 7 

5. Pupil self correction of miscues. 
Pupil improvement is shown by aT^ositively accelerating curve. Is there 
evidence of pupil improvement as measured by the % of self corrections 
yes no 

*NOTE: SELF CORRECTIONS CAN BE ENCOURAGED BY ALLOWING THE PUPIL ENOUGH 
TIME TO SELF- CORRECT BEFORE PROMPTING. 



ITEM 10. TEACHER PROMPTS TOTAL: 

This line of data tells how many prompts were used by the tutor. The 
percent figure is always 100%. 

ITEM 11. PUPIL SUCCESS IN RESPONDING TO TEACHER PROMPTS: 

This data tells how many and what percent of pupil responses to the 
teachers prompting were correct (62 's) or correct exact word responses 
(64's). 
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The effectiveness of tutor prompting can be measured by the percent of 
pupil 62 and 64 responses to the prompting. 

GRAPH THE WEEKLY PUPIL SUCCESS "PERCENTAGES AND INTERPRET 



(ITEM 11) 


Percent of successful pupil responses to prompting. 
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Highest Success Rate 

Lowest Success Rate ' 

Average Success Rate (Approx.) . 

Is Pattern .Consistent Across Lessons? yes no 

Is there Indication of Improvement Overtime (positively Accelerating 

curve)? yes no . 

Increasing the over all pupil success rate depends on many factors. 
Conducting a fine-grain analysis of the data that goes into making up pupil 
miscue patterns and teacher prompting patterns ; (e .g. , sub- categories of 
ORGS) will help you understand the factors that contribute to the success 
rate and also help you plan strategies that should improve the pupil success 
rate. 
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Summary of Goals 

Independent of past performance, all tutors should aim at the following 
behavioral goals. 



1. Increase prompting of 21 miscues . 

2. Decrease prompting of 22 miscuos. 

3. Decrease the average lengtfi of a prompting sequence by limiting 
to two the number of prompts\given in response to a miscue. 

4. Increase the use of all strategic prompts (33, 34, 44, 45, 52 -s) 

as compared to other possible prompting approaches. (Or conversly, 
decrease use of other prompting strategies). 



Based on your interpretation and summary of your first semester per- ~ 
foimance, you should be able to state which of the 5 strategic prompts need 
to be increased most. You should develop the skill and facility to use each 
of these prompts. Begin developing your skill by trying to increase the 
frequency of use of each of these strategies (categories 33, 34, 44, 45, 52). 

Depending upon your analysis of last semesters performance, you should 
aim at the following behavioral goals: 



1. Each lesson should be average minutes . (page 7 ) 

2. Each reading text selected should have about words . (page ) 

3. -Die text selected for oral reading should present a difficulty 
level of about 10%. (page H ) 
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OROS DATA SUMMARY 

OATEt ll/H/75 
NAME! 

Box NOt I 2 
LESSON NO»l 2 

n TOTAL OBSERVATION TIMEl 8.8 MIN. 
2) TOTAL WORDS HEADI ^60' 



3) PUPIL MISCUES TOTAL (21 ♦ 32) 

5) MEANING CHANGE (21) 
7) NO MEANING CHANGE (22) 
9) SELF-CORRECTED (63) 



10) TEACHER PROMPTS TOTAL (31 TO 8) 

12) CONTEXT (52) 
14) STRUCTURAL (33) 
16) PATTERN (44) 
IB) PHONIC (45) 
20) ATTENTION (34) 

22) OTHER 3i 4i 5 PROMPTS 

23) POSITIVE FEEDBACK (71) 

24) NEGATIVE FEEDBACK (72) 

25) MANAGEMENT (73) 

26) TELLING (8) 

27) OTHER (9) 



MiScUES 

NO. PC. 

21 4 

14 66 
5 23 
2 9 

PROMPTS GIVEN 

NO. PC. ■ 



20 

0 
0 
0 

0 

1 

0 

4 

0 

11 

4 
0 



loo 

0 
0 
0 
0 
5 

0 

20 
' 0 
55 

20 

0 



Teacher responses 



4) 

6) 
8) 



U) 

13) 
15) 
17) 
19) 
21) 



NO, 


PC, 


12 


57 


10 


71 


2 


40 


sue. 


(62^64) 


NO. 


PC. 


14 


70 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 



- SEQUENCE LENGTHS. 

FREQUENCY DISTRIBUTION (MINUS IS AND 9S) 
1 2 3 4 5 6 7 8 



9 10 11 12 13 14 15 16 17 18 



1 1 



19 20 21 22 23 24 25 
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MEANS 3.41 
MEDIANS 2,50 
SD» 3.11 

TOTAL DATA STRlNGSs 
TOTAL. CODES (- 1 AND 9) 
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PRINTOUT Kl-Y 



1. Total Observation Time : llecorded automatically. 

2. Total Words Rea d: Lntered into file after lesson. 

rupiL :!isc:iif:r) 

3. I'u])il M iscues Total : Lists total frequency of all 21 and 22 xodes and 
percent miscues. (5/2) 

4. Teacher Pes])onses to all Miscues . Lists total frequency of all 51 , 32, 33, 
34, 41, 42, 43, 44 , 45 , 51, 52, 71,. 7Z, 73, and 8 codes following 2_ codes 
and j-iCrcent miscues res]^onded to. (4/3) 

5. Meaning Qian^ e. Lists total freciuency of 21 's, excluding tliose followed 
by 63 and percent 21 *s. (5/3) 

G. Teaclier ReS])onse to Meaning Clianre . Lists total frequency of all 21 's 
followed by a teacher response (31, 32, 33, 34, 41, 42, 43, 44, 45, 51 , 
52, 71 , 72, 73, and G) and percent 21 *s res]ionded to. (6/5) 

7. N'o Meaning. Chan f.e. . Listr> total frequency of 22's, excludin^j those 
followed b)' 63 and ]iercent 22's. '"^/3) 

8. Teaclier !'eri])onse to No Meaninp, Cliann c. Lists total frequency of all 22 *s 
followed by a teacher response (31 , 32, 33, 34; 41, 42, 43, 44, 45, 51, 
52, 71, 72, 73, and 8) and percent 22's responded to. (8/7) 

9. Sel f 'Corrected . Lists total freciuency of all 2rs and 22*s followed by 

1 

63 and ])ercent 2's self-corrected. (0/3) 

• Che ck i^oi nt > (1 ) Previucncies in 5, 7, and ? must equal frequency in 3 an si 
pcrccnts in 5, 7, and 0 must add up to 100^^. (2) Prcquencics in 6 and 8 
must equal frequency in 4. 



'^^^ ^^■-■^^■-^^^ r.., ...... 

£u,.UiH«». ..is.s .0.: f..„.,„, „ ^^^^^^^^^ 

:-,.s<3,,3., 33. 3.,.,,..,,,,,,,, „^ , 

I'crccnt successful pron;,ts. OhlO) 

12. Context. Lists total frenue-.cv of t11 qo-e 

|i'c.c> ot all .,2's and percent 52 -s. (12/10) 

13. ''upil Su ccess -rnni-,. VI- Mcl-.. * . , r 

r>-<='li™cy Of nil c: .•,,,,1 f,., code, 

fono„i„g52.sa„d percent success of context, (,3/,,) 

1". Structural. Lists tot,,l freouencv of HI j 
_ ' • "'"> Iiercent 33's, (M/lo) 

■ I'lipil Success-.':rr.,^„.rM Lists rotiT 

. Lists .otal fre,,uenc,v of all 62 and 64 codes 

follo-,inB33.s and percent success of structural. (15/1,,) 
1<3. Lists total fre,ue„c,. of all 44.s and percent 44' = . (16/10, 

.7. ian^e,,s,5:atHn,. Lists total fre„„enc>. of all 62 and 64 codes 

following .M.s a.d percent success of pattern. (17/16, 

HiOnU, Lists total fre.uenc, of all 4.5 promts and percent 4S.s. (U/IO, 
iiHiUSuccc. -r!,o^. Lists total frequency of all 62 and 64 codes 
foU" « lUlJ percent success of phonic. (lg/18) 

20. Att^. Lists total fre„„enc>. of all 34.s and percent 34.s. (20/10, 

21. PunnSucc^ss.-^tention. Lists total fre<,uenc>. of all 62 and 64 codes 
following 34. s .and percent success of .attention. (21/20, 
0£l-3,^..^ns, Lists total frenuenc. of all 31. 32, 41. 42 43 
■uxl SI pronpts and percent otl.er 3, 4. prompts. (22/10, 
i:ositiv^^ce^ ^^^^^ ^^^^^^^^^^^ ^^^^ 

24. ^esative^dj^cu. Lists total frenuoncy of all 72.s and percent 72.S 
C24/10) 

33<i 
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25. Manan_cmcnt. lists total frc(|iicncy of all 73's and percent 7.Vs. (25/10) 
ISliilLR* Li-'^ts total frequency of nil R's and ])crcent 8's. (2G/10) 
9lhRL- '-ists total frequency of all O's and percent 9's. (27/10) 



Cliccl; i^nint. (1) Frequencies in 12, M, 16, IS, 20, 22, 23, 2A , 25, and 
26 should add up to frequency in 10 and jiercents sliould total lOO'l;. (2) 
Frequencies in 13, IS, 17, 19, and 21 .liould add up to frequency in 11. 



Section 4. 

Trainee Manual III: Using Feedback for Lesson Analysis and Planning 
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Usinp Tecdback 

There are three kinds of feedback available to you this semester: 

1. Audio tape playback. 

2. CATTS "real-time" TV display. 

3. CATTS printout summaries. 

You Kill use the feedback for analyzing pupil niscues and tutor 
prompting strategies, and then use the analysis for setting Roals for 
the next lesson. 

P.ach tutor will do three lessons with either CATTS FR or AUDIO FB, 
and then continue with the alternate FR method every three lessons. 

This manual describes how to use and interi)rct the audio-tape and 
CATTS TV display. Interpretation of CATTS Printout is found in Trainee 
Manual II (orange cover). 

ALL TUTORS ^niST ANALfZF FACII LCSSON FOR UHTCII TIIFY 
RECniVF FRFPRACK; COMPLFTE TUP FPPDRACK EVALUATION SHEET; 
TURN IT IN BPFORP THE NPXT LESSON, 



33, 



Audio Tape Feedback 

^•hen you are scheduled for audio feedback, he sure to pick up the 
cassette tape of your lesson and maV.e arrnnpcments to hear it played 
back before you teach your next lesson. 

There are two cassette playback devices reserved for K4P5 tutors 
in room 160 of CIT.I. and you can use these at anytime of the day. You 
may also take the cassette home. You must however, return the >assette 
before your next lesson . 

The analysis of your lesson will be .ore accurate if you tally the 
important pupil and tutor behaviors you her on the tape. Use the tally 
sheet and fill out as sho»^ on next pane. 
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Audio Tape Tally Sheet 



Tutor Pupil date of lesson 



Pupil Jliscuos 




Prompted? 




'^1 - ?teaning change 


total } 


YES 1 total 


NO 


total 




1 

//// 




// 




22 - No meaning chango 

//// 


1 
1 


// 




// 





totals 



Context 52 


/// 




Structure 33 






Pattern 44 






Phonic 45 






Attentior* 34 


// 




Telling 8 






Other 
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CATTS Tv' Fnr.nRACK 

For three oral readinR lessons, the video monitor in the booth will 
be turned on. The screen will display a moving bar graph that changes 
as you prompt. It will show you which prompts you have used up to that 
moment, and the relationship between use of the different prompts to 
each other. 
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video screen displays 
showing five strategic 
prompts, other prompts, 
and telling. 



Example 1 



How it works: As you prompt, the coder transmits the code for the 
prompt to tlie computer, which then instantly shows its occurance by moving 
the bar for that prompt up a notch. IvTien you first start your lesson the 
bars are flat alon^ a horizontal axis, and the number ten shown at the 
top of the vertical axis (not actually seen). As a prompt occurs, the 
bar rises a constant amount for each occurance. A bar halfway up the 
scale tells you there have been five prompts for the category represented 
by that bar. 
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EXiimple 2 v. 
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In example 2, you can see that there have been five S2 prompts, 
about 7 or 8 Other prompts used and two 45 promi)ts used. 

hll AT IIAPPr.NS WIHN TUF.Rr . ARH riORF: THAN TdN PROMPTS? 
As the bar for any catecory reaches ten, the display will cut j)ff 
for a moment and tlicn reappear scaled down by one-half! A 20 will show 
on the vertical axis in place of the in and each bar will be half as 
tall as it was before. See example 4. 
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1-1 



u _ 
U 5r 



n 



Ten Scale for beginning 
of lesson. 



Twenty scale used after , 
any category reaches ten. 



r.xample 4. fhnnrc in scale after ten prompts in any one catepory- 
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By looking at the whole display, you will he aMc to tell at a 
glance which category sof the 5 stratopic prompts needs to be increased 
in relation to the other four, which needs to be decreased in relation 
to the others, or it may tell you that all 5 prompts are it about the 
same level - no chnnpes needed tliore. 

The n column shows the frequency of use of dysfunctional prompts. 
If it starts Retting too much taller than the other columns, try to 
decrease the use of these dysfunctional prompts and increase the use 
of the five strategic prompts. The eight column tells you how often 
you are ■tolling" in relation to use of all other prompts. 
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CATTS 



Feedback Evaluation Sheet 

Pupil 

□ 



Date cf Lesson 



AUDIO 



1. Length of lesson (:;; in. vccs) 

2. Niimbor of v;:rds re-'^'^ ^ 



Increase 



I ^- Pifi-iolty level l^^^L^j 
I '1. Ko. of pv-pil 21 iniscufjs 

t 

j 5. of p'^r-ii 22 niir^rje.'; 

I 6. No. 21 -n pi'on'pt'rd 

j 7. No. of 22 's prompted 



1 

Decrease i Mr? In tain 




/X ! /X i 



i rt. Averdge length of prompt sequence 



f 
I 

1 

I 



(52) Covitoxt 



J.. 



(Zj) _'^'>y-'-'VJlZ'l- 

(44) Patterr _ 



1 



f4rO Pl;o-uc 



(M)_JVtt£Pt3^ 

0 1 Vi.'-r^ r.I2:v jI!*.^- 



■1 
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Section 5. 
Sample Printout Form 
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ORGS DRTR SUMMRRV 



DATE; 2/16/76 
KflME J. GOTTS 
BO>r NO. ~. ' 6 



LESSON NO 



1) TOTRL OBSERVflTIOM TIME; 14 
2; TOTAL i-JQRI^S- RERD : 402 



M IN. 



MISCLIES 



TEACHER RESPONSES 







U0,__^^ 


_ PC. 




HP.- _ 


PC, 


2.' PUPIL NISCUES TOTHL ':21 + 


2 2 ) 16 


s 


4> 


5 


56 


5) 


. MEANING CHANGE 21 ) 


11 


68 


e> 


9 


SI 


. 7) 


H O " M E fl U I N G C H ft U G E ^ 2 2 f 


4 ' 


25 " 


8 ) " 


'0 




9> 


SELF-CORRECTED 6 3 > 


1 _ 


6 












PROMPTS 


G I V E « 


PUPIL 


sue. 


( 62+64 > 






NO. 


PC. 




NO. 


PC. 


10' TEACHER PROtlPTS TOTAL (31 


TO S) 2 3~ 


100' 


11 ) " 


14 


60 


12)" 


' CON'TEKl " ':5 2;' 


4 


' 1? 


13)" 


. 3 


75 


1A> 


STRUCTURAL (33) 


9 


2 5 


15) 


4 


44 


16 ' 


PATTERN (44) • 


1 


4 


17) 


3 


100 




PHONIC <45) 


e 


0 


19) 


0 


0 


20) 


ATTENTION (24; ' 


T' 


~4 


21) 


1 


100 


'22) 


"O T H E R 3 . " 4 7' 5~ PROMPTS 


6 


"26 








23) 


POSITIVE FEEDBACK (?1) 


0 


0 








24) 


NEGATIVE FEEDBACK (?2) 


8 


0 








25) 


HANfiGEHENT (?3> 


. 1 ' 










2C-' 


TELLING " 8 ) 


1 


4 









(9) 



339 



SEQUENCE LENiiThS 



FREQUENCV DISTRIBUTION (MINUS IS RND 95; 
2 4 5 6 7 5 



1 2 



9 10 11 12 i:< 14 15 16 17 IS 19 2B 21 22 23 



0 



0 



0 



0 



& e 0 0 8 e . 



MEflN= 2. S2 
HECHftN= 2. 63 



5D= 4.13 



TOTAL DfiTfl STRINGS^ 17 
TOTAL CODES<- 1 fiML- 9 > = 65 



INTERACTION SEQUENCES 



730 108 

211 420 618 330 610 320 620 230 61B 800 64B 



213 3 40 648 180 

210 520 620 100 520_ 640 720 _^ _ _ 

223 100 

213 620 100 ^ _ 

"212 100 "730 Too l;i0"310 620 410" 620 330 610 320 610 330 330 620 

330 640 100 

440 620 310 6'10 180 



213 
224 
212 



T ") *^ 



212 
2 1 2 
2 20 



100 230 100 720 100 _ 
100 

J.0O 520 640 100 

100 " " 

220 64_0 

To"o 

100 

64 0 710 610 22 0 640 710 
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DATE: 
NA^E: 
BOX NO. 
LESSCW NO. 



1. Total Observation Time 

2. Total Words Read, 



Pupil Miscues Total (21 + 22) 

Meaning Qiange (21) 
No Meaning Change (22) 
Self-Corrected (2 -63) 



Teacher Prompts Total (31 to 8) 

Context (52) 
Structural (33) 
Pattern (44) 
Phonic (451 
Attention (34) 

Other 3, 4, 5 Prompts 
Positive Feedback (71) 
Negative Feedl)ack (72) 
Management (73) 
Telling (8) 
•Other (9) 

Sequence Lengths 

Interaction Sequences 



Miscues 
No. ' 



3. 

5. 
7. 
9. 



Prompts Given 
No. % 



10. _ 

12. 
14. 
16. 
18. 
20. 

22. 

23. 

24. 

25. 

26. ~ 

27. 



Teacher Responses 
No. % 

4. 



6. 
8. 



Pupil Success (62+64) 
No. % 

11. 



13. 
15. 
17. 
19. 
21. 



Included on first 
semester printouts; 
not included on 
second semester 
printouts until 
after Lesson 17 



OROS fata Sumniary (Printout) for Tutor 
Lessons and Printout Key 
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P'^.I.'.TriiT KTY 



^' Total Observation Ti;^: Recorded automatically. 

2. Total V.-ords Read: Cntercd into file after lesson. 

PUPIL r;isnjnr> 

3. rilJ2iiJUlEH«_Jf^ Lists total frequency of aH 21 and 22 codes and 
percent r.iscues. (3/2) 

4. Teacher l-.es|.onses to a 1 l _^!i^cnes . l.Lsts total frequency of aH 31, 32. 33. 
34. 41. 42. -,3. 44. 43. 51. 52. 71. 72. 75. and 8 codes followinn 2_ codes 
and ]iercent niscr.es resj^onded to. (4/3) 

5. Meanin, Cha n,^. Lists total frequency of 21.s. excluding those followed 
by 63 and percent 21*5. (5/3) 

6. I££cherjesi20nse_^^ Lists total frequency of aH 21's 
followed by a teacher response (31. 32. 33. 34. 41. 42, 43. 44. 45. 51. 
52, 71, 72, 73, nnd 5) and percent 21-s responded to. (6/5) 

7. N'o Meanin j^nj^e. Lists total frequency of 22's. excludinR those 
followed by 63 and j^ercent 22 's. (7/3) 

8. Teach er Penponse t ^^igJi^IiniiLgJill^IlCC ■ Lists total frequency of .11 22's 
fcllo^ved by a teacher response (31 , 32, 33, 34, 41, 42. 43. 44. 45, .;i. 

71. 72, 73, and 8) and percent 22's responded to. (8/7) 

9. Self-Corrected . Lists total frequency "of all 21's and 22's followed by 
63 and percent 2'5 sel f- corrected. {9/3) 



CIl£cLj]oi.n_t. (1) Frequencies in 5 . 7. nnd o „„,t equal frequency in 3 and 
pcrccnts in 5, 7, and 0 nust add up to 100';. (2) Frequencies in 6 and 8 
must equal frequency in 4, 
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10. /eache r P ror^'js^ JFotn^l. Lists tctnl frequency of all prorpts (31. 32, 33, 
34. 41. 42. 43. 4-;. 45. 51 . 52. 71. 72. 73, and 8) and percent pronpts. 

(1001) 

11. Pupil Succcs^. Lists total frcni:ency of all 62 and 64 codes following 
rronnts (31. 32. 33. 34. 41 . 42 . 43. 44. 4.--,. 51 . 52. 71 . 73. and 8) and 
l»crccnt successful pror«)ts. (11/ in) 

12. t^OMtcxt. Lists total frequency of .ill 52's and percent 52's. (12/10) 

13. '-uril Sucxess-n^iucxt. Lists total ircuicncy of all 62 and 64 codes 
follcviiig 52's and jiercent success of context. (13/12) 

M. Structural. Li.<;ts total frequency of all 33's and percent 33's. (14/10) 
j 'upil Success-Structural . Lists total frequency of all 62 and 64 codes 
follo-dnj'. 33's and jiercent success of r,tructural. (15/14) 

16. Pattern. Lists total frequency of all 44's and percent 44's. (16/10) 

17. P,upil Success-Patteni . Lists total frequency of all 62 and 64 codes 
following 44's and percent success of pattern. (17/16) 

18. Plionic. Lists total frequency of nil 45 prompts and percent 45's. (18/10) 

19. Pupil Succcss-Pl.onic. Lists total frequency of all 62 and 64 codes 
folloiving 45 njid jierccnt success of plionic. (19/18) 

20. Attention. Lists total frequency of all 54's and percent 34's. (20/10) 

21. 1' up i 1 Su c c cr'^-^_lSntion. Lists total frequency of all 62 and 64 codes 
folloKinn 34's and j^ercrnt succe.<:s of attention. (21/20) 

Other 3. 4 , 5 Pronpts. Lists total frequency of all 31. 32. 41. 42, 43. 

and 51 j^ronpts and percent other 5. 4. prompts. (22/10) 

''ositive feedback. Lists total frequency of all 71 's and percent 71's. 

(23/10) 

24. Xcr.ative Feedback . Lists total frequency of all 72's and pcr.ccnt 72 's. 
(24/10) 
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25. flanag ercnt. Lists tofTi 

total frc(!i:cncv of all 7T;<e > 

26 Tnii- - s and percent 73's. (25/10) 

26. Temng. Lists total freauencv of nil 8'. nn , 

27 on ' °' '^li « '-^nd percent 8's. (26/10) 

27. Other. Lists total frequency all o-. , 

I nc> 0. all 0 s and percent 9's. (27/10) 



oieci^. (1) p,,.^,,,,,„ ^^^^ ^^^^ ir,~;r^";r~~ 

: - — >' - -cents ...'tot:;.;' ;: 

Frequencies in 13 is 17 m ^ ' ^ J 

'^^> 17, 19, and 21 sliould add un tr. r 
" ^^P to frequency in 11 
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Printout of Matrix 1: Pupil Miscrie by Teacher Prompts 
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l71103JiOUl IW 152 ii 1I^1?50JC 2 iJ2 7 7M333 



PU^Il 13 31- ]l- 33- 34 
I'D 



TtACHEk Pi<OH?TS 

■1-2 41- ;2- -.3- 44- A'i- --1 -2 51- 52- -1 ~2 65 71 72 73 7* 8 ?,CSP NRS 63S 



0 0 J 0 0 ) I 2 J 0 3 d 3 I 0 I 0 
J J ) 3 J J 14 23 J () 0 0 100 14 0 100 0 



0 2 0 0 0 1 

0 2a 0 0 0 14 



7 



0 



J ■) I l) 'J 1 

I J IJJ 0 J lJu 



0 3 3 J 3 3 0 
0 3 J 3 3 3 0 



0 0 0 0 
0 0 0 0 



0 0 0 0 
0 0 0 0 



0 0 



) 'J J ) ; J I) 1 J 0 0 0 0 2 2 4 0 0 
J fj 3 3 J J J J 0 3 0 0 15 15 100 0 0 



10 10 7 
7 0 7 0 53 



13 



7i 



21^ 



J 0 ) 0 3 J I) J 0 0 0 0 0 

3 J 3 .) C J 0 3)0300 

3 0 ;] J '.1 J 0 3 J U 3 0 0 

3 0 J 0 3 J ) 0 J 0 0 0 0 



0 0 0 0 

0 0 0 0 

0 0 0 0 

0 0 0 0 



0 10 10 3 
0 20 0 20 0 59 



0 0 0 0 
0 0 0 0 



0 0 



mi 21- HQS = 26 
PERCENT 21- HQS - % 
PERCENT 21- HOS AKD 63 S * 3 



00 



221 



in 



2:5 



U J 



0 0 J 

0 3 3 



J J 0 
0 J 3 



3 y 
0 J 



J J J U J 
0 J 0 3 , 

J J 3 J 3 



3 1/ 3 J 3 0 0 

0 ■„ J 0 0 0 0 

3 3) 3 3 0 0 

0 0 ,) 3 0 0 0 

') 3 1) 3 3 0 0 

3 0 ) I) 0 0 0 

3 0 3 J 3 0 0 

0 3 3 3 3 0 0 



0 3 0 0 

0 0 0 0 

0 0 0 0 

0 0 0 0 

3 0 C 0 

•0 0 0 0 

0 0 0 0 

0 0 0 0 



0 0 0 0 1 

0 0 0 0 100 

0 0 0 0 3 

0 3 0 0 0 



0 0 0 0 

0 0 0 0 

0 0 0 0 

0 0 0 0 



0 0 



2 1 



TOTAL 22- HQS = 1 
PERCftJ 22- HOS = 3 
PEFCENT 22- HQS AND o3S - 7 
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Printout of Matrix 2: Teacher Prompts by Pupil Responses 
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maTnIX 2 T^ACH = '5 PUUyPTS BY.P'JPIL .•v-5P:f«5ES 
TCHR PRMT:> 61 62 6V 65 35^1 loTS 
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PL«C = NT OIRtfCT= '53 

PERC-:NT IM0IKECT= 46 

Pi-RC'-MT SUCCESSFUL PROMPT S= 62 

FReOUENCY 0I5TRIBUT 10.4 (MINUS IS AND <?S) 
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 2 1_22 J3 J W. 5^ 

""6""2~'i6""2"~r~r"7'o ojjooojooooooao _o_o^ 



MEA<J= 3.3 9 
M[3IA;>1= 3.13 
S0= 1.66 



DATA LIST 
,730 

210 422 610 900 640 
.212 800 640 100 
212 710 610 422 61G 800 640 100 
210 41? 61G '^^0 640 100 710 100 
212 521 610 511 640 71J 
212 100 

212 100 100 521 640 

213 730 610' 8)0 640 100 IJO 
213 800 640 

22 3 100 
212 100 

212 511 610 8J0 640 100 
224 

210 710 640 100 

213 800 640 100 
2b2 800 6'+0 

212 730 610 800 640 
212 800 800 640 
224 630 100 

212 600 64 0 

213 800 640 100 

222 100 800 511 
210 800 640 100 

210 511 640 100 
2 10 710 640 100 
213 630, 100 
212 800 640 100 

223 100 

211 332 620 442 610 800 640 100 
223 100 100 630 341 640 100 

212 511 640 100 
212 800 640 

212 800 640 

213 710 610 800' 640 100 
210 422 610 800 640 
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Tutor Evaluation - Afternoon Session Feedback 
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Tutor Evaluation-Afternoon Session Feedback 

Second (Present) Type of Feedback 

Date 



Please take the time to fill out the last of many infamous forms. Names 
arc not necessary. None of these will be looked at until final grades 
are turned in. lhank-you for all your patience and cooperation. Good 
luck in the future. 



1. Ilave you been satisfied witl\ your present feedback' 



2. Miich portion of your feedback was most helpful? 



3. \Vliat were, the advantage and/or disadvantages of your feedback. 



4. Now that you've experienced both, which feedback would you prefer and 
why? 



Tutor Evaluation - Practicum 



fe!t it ;L ^ th k rate each item on the basis of how useful you 

c^LJj ; 1^ being most useful and *1 being least useful. Add any 

JHwH n°^. T ^/ ^'^^^"^ ^ particular item feel free 
to write on the back of the page. 

Discrimination Training 

1* Learning codes 5 'i 3 2 1 

2. Filling out coding exercises 5 'I 3 2 1 

3. Taking Criterion Tests 5 4 3 2 1 

Use of Feedback for Training Purposes 

4. Analysis of feedback (Read printout or 5 4 321 
listen to tapes) 

5. Filling out feedback sheets 5 ,| 3 2 1 

6. Filling out graphs 5 4 3 2 1 



Performance Objectives 

7. Prompting of 2l's only, not 22's 5 4 3 2 1 

8. Give pupil time to self-correct by 5 4 3 2 1 
waiting until end of sentence to prompt 

9. Shorten length of prompt sequence 5 4 3 2 1 

10. Increase use of Module Prompts (75%) 5 4 3 2 1 

11. Decrease use of Other Prompts 5 4 3 2 1 

Teaching 

12. Teaching 2 hrs. week (versus 1 hr.) 5 4 3 2 1 

13. Diagnostic testing of your child 5 4 3 2 1 
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14. Giving Criterion Reading Tests 5 4 3 2 

15. Filling out Lesson Plans 5 4 3 2 

16. Oral Reading in booth 5 -1 3 2 

17. Computing and maintaining 10% error 5 13 2 
rate for oral reading 

18. Materials available to you in classroom 5 4 3 2 
or from Mary Ulla or Darla 

19. Switching cliildren for one oral reading 5 4 3 2 
lesson 

20. Conferences with Darla 5 4 3 2 

21. Recall Interviews 5 4 3 2 

22. Progress letters to parents at end 5 4 3 2 
of semester 



Constructive Criticism/Suggestions for Improvement in any area of 
practicum 



O n 



Section 11, 
Summary of Responses to Tutor Evaluation 
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Summary of Responses 
Tutor nvaluation-Aftemoon Session Feedback 

1. Have you been satisfied with your present feedback? 
(7) Yes's 

Yes - I have been satisfied with the feedback. I like knowing what Tve 
done according to someone else's opinion. By looking at the 
sequences I got to see what I did prompt and which prompts I used. 

Yes - It was £^11 really helpful. At first I was rather confused, but 

with time I learned, became more organized myself, and understood 
what was going on. 

Yes - I like being able to see (approximately) what I'm doing. 

Yes - I am enjoying CATTS alot, it has helped me learn the code and the 
rest of this observation system^ 

No - I feel it isn't as accurate as the CATTS feedback. 

No - I wish I knew whether or not the tapes I've coded are accurate. 
But, I enjoy listening to my tapes. I feel I've learned alot 
from listening to my mistakes. 

Ko - There is no way to accurately check my reliability, I am pleased 
to listen to the tapes but the feedback appears to contain a void 
in tliat it provides no definitive instructional diagnosis. 

I had been satisfied until recently. M>' tapes have been very 
, difficult to hear. 

\Vhat can I say'' For one, it was very time consuming and an in- 
convenience iv that it was necessary to go to the library and 
locate a casst^tte recorder 

Somewhat . 

Basically I would have liked to get both types of feedback. 



2. \Vhich portion of your feedback was most helpful? 
Filling out th - -hcets. 

Realizing the varying context clues and structured prompts. Also the 
inconsistency of some prompts and the frsquency. 

How about the Feedback Evaluation Sheet i 

It helped me alot to be able to listen tc the entire oral reading session 
again. It reinforced what I had done correctly and made me realize the 
duF*) prompts I'd made. 

erIc ^''•^ 
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I ehjoy examining the quality of the niscues. Variations {J relation- 
ships in. 21 and 22 are nost informative, 

I enjoy- listening to my tape, I've found out some of ny weak traits 
(Hx. being irritated when Daves messing around with ^^ike,) I also feel 
my prompts are improving. Instead of using one type of 33, I use several. 

Listening to myself prompt. 

Prompt sequence is the most helpful. I have learned from this portion 
of the feedback, how accurate I'm doing on the amounts of prompts arid 
how to stop going so many. 

Seeing the graph on the screen helped me to concentrate on increasing 
the appropriate prompts. 

The immediate feedback on the montor helped me alot for immediate 
knowledge of where I was. In long run terms the graph really helped 
me analyse my prompting. 

Two portions helped: (1) the module prompts and other prompts showing 
what I did or didn't do, (2) the sequences (helped me see how long it 
took to prompt and which miscues were and weren't prompted.) 

Well If I gave i prompt and was not sure which category it fell under 
it was helpful in that it showed whatoprompt. 

Knowing the frequency of prompts given. Also hearing one's voice on 
tape. 

The portion that was most helpful, was knowing exactly what prompts I 
had given. Also looking at the interaction sequences and knowing what 
prompts helped Mark get the word he was stuck on. 

Coding my miscues. 

The taping and sheets to be filled out, 

I feel that the instant feedback gave me an incentative or motivation 
but the evaluation sheet is a permanent record. 

The graph is the most helpful part cause I can actually see what I've 
been doing. Looking at the numbers doesn't tell me much. 

3. What were the advantages and/or disadvantages of your feedback? Be 
specific. 

The advantages were that it was easy to record and it was fairly immediate. 
I saw. no disadvantages except sometimes there were delays--bu-: that's minor, 
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Advantages: Instant feedback. 

Disadvantages : Cannot compare strinc^for my marked miscues because can't 
decide which goes where. 

You can understand your progress 5 percentages more by figuring them 
yourself. 

You can remember exactly what you did. Tm' never sure if they are 
coding the sane way I am. If I was sure that I coded the exact same 
then it would be better. 

It didn't take too long to do the CATTS feedback and I could spend more 
time on special activities for ^'ark• There has been several times I 
thought I was giving a certain prompt (an mod. prompt) and I was giving 
a prompt which was not a mod. prompt. With CATTS feedback this was 
caught and explained to me, which hzs helped very much. 

Advantage: Hear yourself on tape. Have written on paper what promx)ts 
you are to increase. 

Disadvantage: Is not immediate as CATTvS. In CATTS you know th i and 
are reminded what prompt was given. 

At first it was more of a disadvantage because it tended to distract 
the tutor. But is soon became advantageous as the tutor got use to it. 

The advantage was being able to see as soon as the lesson was over and 
while it was going on what prompts I was using and didn't use. 
The disadvantage was seeing that I wasn't using certain prompts that 
were expected of me, and trying to use them that I wasn't comfortable 
and sure of what I was d6ing. 

Immediately knowing what prompts I am using. Records of past prompting. 
Disadvantages: T.V. distracts John, could be some errors in coding. 

I have never agreed with thie feedback sheet as far as numbfer of rescues/ 
or prompts given. I don't know if the coder can't hear me or Mi.x-i.elle 
or what. I usually mark miscues on my xeroxed copy and our numbers 
never match . 

Advantages: Concentrating on one specific prompt has helped me with 
my feedback in increasing the particular prompt--I have learned to 
overall go 15% on 52's, 15% on other, and 7"% on m.p.'s. Thanks. I 
won't forget this for a long while. 

Advantages: listen to yourself prompt. 

Disadvantages: CATTS takes less time. Is it really accurate. 

I like an accurate feedback such as CATTS. I know my coding is close 
but I wonder how close it is. 

Time consuming (in relation to CATTS), lack of reliability, and lack of 
specific diagnostic information (more as result of the coding system, 
rather than the feedback itself.) 



Again, I was greatly benefited by hearinp the session over again. But. 
often the tapes are not real clear which made it difficult to hear wHa"t 
the child was saying. 

I have alr«»ady mentioned the disadvantage in it. 

Advantage: Possibility to write down what child says accurately and 
thus being able to be fully attentive during oral reading. 

Disadvantage: Not being able to see the prompts as being given--to be 
able to change prompts. 

Because I wasn't sure if I was coding myself correctly, i.e,, if I 
think I'm giving a 52 and I'm not I still code myself as a 52. 



Section 12. 
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Kane 
Week 



Oral Rca dinr. (7) 
Objective :-tatctl 
Vccd for that skill 
Title M level of book 

Title of story 

Pafje numljcrs 

Nvunber of words road 

Total number ol' errors 

Other Skill A^e an (11) 

A. Objective stated 

1 . r. i ven 

2. Behavior 
OR 

B. CR 

1. J.imbcr 

2, Brief heading 
Materials listed 

1. A^.curnte r, conrlctc 

2. Correspond to nctivity 

Activity Discript ion 

1. l^escril^e puinl belinv^ior 
Iiescribc ticr.clicr i)chavior 
ncscriiie tisc of ninterial?. 
Hive any directions 
nccessnrv for underr tan ding 
the activity. (Assuno the 
reader is totally unfamiliar 
with anytiiinn other than 
C.R. pre G post tests) 

i-valuation Troccduro Stated 

1. Is different fror activity 
(^instniction in '.>ki 11 ) 

2. Is appropriate test of 
designated skill 

OR 3. One d two above fulfilled 



Lesson Plan Cliecklist 

Scl f i'.valuation 
!\iv 1 nay 2 



Supervisor Hvaluation 
Day 1 Ikiy 2 



4 



by a CR pose test. 



♦Comients Section Fillet^ Out 

1. Are a realistic .Mterrre- 
tat ion of the events that 
occurred. 

TOTAL 



-t 



TOrAL rOIKTS 20 



Section 13. 
Lesson Plan Form 



LESSON PLAN 

Tutor/Pupil . Teacher Education Laboratory 

Tutorial Program in Reading 

H'eek 



Day 1 



Day 2 



SPECIFIC 
OBJECTIVES 


MTERIALS 


ACTIVITY 


EVALUATION 
PROCEDURES 


c 

u a 

0 0 


f 
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■H H 
*M H 

on 

fi (A 












ComeRts 








u 
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Li (« 
0 © 
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Comnents 
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Sample of Informal Reading Inventory Materials 
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Ntod \ Date 

Oral Reading Passage 
Seeking Adventure (Level 4^* 

A True Tale 

Another man and I were studying water birds in Alaska. One day I was alone, 
padd:iing op a stream. A black bear on the bank saw me. He plunged into the water 
and came for ae. I landed. Then I grabbed my pack and climbed a tree. Th^ hear 
followed. 

The bear climbed up the tree after me. He bit my right boot. But when I 
kicked him, he let go and dropped to the ground. I tried to go higher. But I lost 
my grip on the tree trunk, and I slid to the ground. I threw my pack aC the bear. 
He grabbed it and moved away. I climbed a bigger tree. 

Soon the bear was back. He came up the bigger tree after me. Once he bit my 
left boot. I yelled. I shook the tree. I even threw by binoculars at the black 
bear below me. The bear did not go away until my friend came looking for me. I 
was not hurt, but I had been up a tree for two hours. 



EKLC 



*This is a sample from ona level out of a set of materials for levels 
preprimer to fifth. 
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Coo^rehension Questions 
Where was the man when the bear went after him? 



What did the man do when he saw the bear? 



Do you think he was afraid of the bear? 



Why did the man kick the bear? 



What did the bear do when the man kicked him? 



Why was the bear chasing the man? 



Do you think it was a good idea for the man to have gone out 



l^hy do you think the bear left when he saw the man't friend? 
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Iftord Recognition list 



baby 
boat 

candle 

cookies 

doesn't 

fed 

f'jany 

help 

join 

lonely 



much 

page 

present 

sadly 

s^ign 

stasip 

terrible 

turn 

whistle 

;:oo 



♦This is a sample from one level out of a sot of materials for levels 
preprimer to fifth. 
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COMPREHENSION 38-3 
Inferring Main Idea 



Can you read a story and then tell its main idea? Let's see. 

Read the story about Helen. Under the story is a question: "What do 
you think is the main idea of the story?" The right answer has a 
circle around it. That is how you will mark your answers. 



Helen went to a L'rthuav party. She saw her 
good friends. She played games that v^ere fun. 



What do you think is the main idea of the story? 
^^^len had fun at the party. 

b. Helen has friends. 

c. Helen plays. 

Now r-ad the story in the next box. Then read the question under 
it. Circle the right answer. Then do the rest of the boxes. 



A fire sia -r^d in the house. The fire trucks came. The 
firemen worked very hard. But the firemen could not put 
out the fire. 



What do yo, hink is the main idea of this story? 

a. The fire started in the house. 

b. The ^irernen came to the fire. 

c. The firemen worked hi'; J, but the house burned 
down. 



d. The firemen worked hard and saved the house. 
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Dale was v.atching T.V. He did not want to go outside. 
Dale hoped the show would never end because it was so 
good. 

2. What do you think is the ma-n idea of this story? 

3. Dale did not go outside. 

b. Dale liked the T.V. show very much. 

c. The T.V. show was very funny. 

d. Dale did not have anyone to play with. 

Danny went fishing with his father. They said they would 
catch many fish. Danny said he would have fish for dinner. 
When Dannv and his father came home, all they had was 
their fishing poles. 

3. What do you think is the main idea of this story? 

a. Danny and his father did not catch any fish. 

b. Danny and his father went f isliing. 

c. Danny had a fishing pole. 

d. Danny v/anted fish for dinner. 
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COMPREHhNSION 38-3.1 
Irentifying the Main Idea in * Picture 

SAY: Read tho directions on your page silently az ! read them 
aloud. 

Can you look at a picture and te!! the rr.ost irrportant thing or idea 
in it? Let's see. 

Look at the picture of the two boys be!ow. Beside the picture are 
three words. Which v^ord teiis the most important idea in the 
picture? It is the word fight. Fight is circled because it is the correct 
answer. This is how you will mark your answers. 




Now look at the pictures below. Choose one of the three words 
beside each picture that best tells the main idea in the picture. 
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Number correct needed to pass: b 
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COMPREKENSIOX 38-3.3 
Identifying tne SiateJ Main Id^a 



Let's see how •.\'en ycu can choose t.V; part of 3 story that tells its 
rnain idea. 

Read the stcy aoout Jane below. Under the story is e question: 
"What is the main idea of the story?" The correct answer is circled. 
This I> how you wiil mark your answers. 



Jane is a good reader. She reads her lessons fast. 
She the ?e5t of js with hard words. 



What is the main idea of the story? 

a. Jane goes to school. 

b. Jane helps us. 




c. Jane is a good reader. 



Now read the story in the next box. Then read the question under it. 
Circle the right answer. Then do the rest of the boxes. 



Ronald likes to play kickball. He likes to play footboril, 
baseball, and tag. He likes tc play many kimi^ of games. 



1. What is the main idea of the story? 

a. Ronald likes to play football. 

b. Ronald likes to play many games. 

c. Ronald does not like to play hopscotch. 

d. Ronald likes to play kickL jII. 



TURN 
PAGE 
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j Tonya rac snort hair. Everyone liked Tonya's hair. But 
j Tonya did not «^ke re^ ^■c]r short. She v/anted iong hair 
j like he'" sister's. ^^^^^^ 

2. What is the main idea of this story? 

a. Everyone liked Tonya's i^air. 

b. Tonya wanted long hair, not short hair. 

c. Tonya liked her sister. 

d. Tonya's sister liked short hair. 

Tom fights with other children. He will not let anyone 
play with his toys. He is not very nice to anyone. Tom 
does not have any friends. 

3. What is the maii. .jea of the story? 

a. Tom has no toys. 

b. Tom is bad to his teacher. 

c. Tom f igl^ts with all his friends. 

d. Tom does not have any friends 
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v.OLCGY: PERTORMAWCE OBJECTIVlo* 



Level 2 
24 1 



u::;:^^ a-J io.'.er CdSe ! .i-rs. the piipi! 



2^ 



24 ^ 



2A 



^O'/.s of vo'.v*j! :**:refs -.vith ora!l>' speciiicd letter 
• tf» pupil idcTui^i-s lever casi^ v( ... : letters with 
J f iccur ?cy. 

' ■ r^r-.s CO:.s ;naMt lotto;s . ,;,:y spccifjtjd 

^. • ri -ovvt> of ;..>itcTs v.itp oraily specified It^'h-r finir.cS. the 
idLHiifies jpp. : rase letters v;ith 95 . la.uracy. 

24 2 Givv-i consonant lexers, the pup, I Jdei.t-hos uiittal single 

^^^'y- ' :.'>J-ids of oraily sp-cified words with 95'o accuracy. 
24 V , of pictures, the pupil identi^.-<; initial single 

b....;^ds o1 oraUy specified words (iHuoU.,ted by the 
|i' -t .-es) v\ith 957'> uccuriicy. 

■ v^^soMjMt !.'n-;>, the pupt! id^iuJ-'s fit],}! ng'!' 

oral! / specii'ed words with 9h 



24 3 



-::4 1 . 



Level 3 

^ ' ' ^;>-'^-'cf letters, the pupil is able to wr^te letters m 

: v*»r rase pairs with 95'/^; accuracy. 

' "f^^'''y specified vowel lettf:.' names, the pupil 

M. »Mifies each vowel by v;riting its lower case form with 

' accuracy, 

34-1 / H.i-i orally specified vowel letter names, the pupil 
■ I- <.(fies each vowel in writing its upper rase form with 
. accuracy. 

! -'1 oral'y specified conson;nt letter n.im.'s, the punil 
-i^t::; t.ach consun.int Ijy witting its luv.uf case fo;.n 
9b' M accuracy, 

^ ' '''-''^ ''^^•'"V specified copsoticitnt letter na ries, the pupil 
K.' Miifi' s ^jach consonant uy writing ds upper case form 
95^0 accuracy. 

^ ' sP^^cif ed words with long vowel soiuuis. the pupil 

" • ^^'^^J '■'O-vel sound by writing the correct vowel letter 
Vi/ith '. .,.t:i iracy. 

34 2. ! i^'...n rows of vowels w .th orally specified words, the pupil 
id. Mtifies long vowel sounds with 95% accuracy. ' 

34 3 Giv-. ^ -.nerified words with short vowel snufuJs, the pupil 

•'i Ih.' .iort vowel sound by writing the coircct vowel letter 

wMh . .jjt wracy. 

34 3 i Mi.vn rows of vowels 'th orally S()ecifie(l words, the pupil 
• I iifies short vowel . .unds with 95% acci^arv 
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STHlK. , iJr, -.L A'NiALYSiS: PERFORr.: A'; CE OBJr..nVES: 



Le.'^l 2 



2b 3 G:. r,- s.- '.-: ij cij:i:S fohoAi^i l)f sel5 of t'vc-^ 



■•^ ••;5. r^-..;j i cUr^StfTS sin.jjlj: ;;^s-.7CSSive I'uiin.s 

. .p]-; CMfitM r^inq soni^ t'r nst suffixes, l^'ie pupi! 
' <*( ti."^ r^\tf'j-jO i^v ticlclinr; er c esf w ih 9b - dCCLiracy. 

' fi .';rl)S, '.S', fa'L'S, or hjW. ,\\\\\ lists iMfiMJ WUfMs, llv.l 

, • -'i .j^r^ii;ort<K)t irreyuiar verhs, prcsei^t tense, witV> 9b"o 

'M ;i-,:s 'jf v*jrl)s contairiinq sojijL' vvilii suffix, the 
, c!.i*i-.»}ios v'jrl: efiJ'.rujs with 95, 'o dccufdcy. 
V 'j'l iiuts of '.vords contrnning some contf liCtions with 
')t ro /j?^ vj'll, dfid /?rjf. the piioil classifies 

:f r : 'ins .Vi tM Ub' JCCur.i . '/ . 

: ^.^-'-s, {\w iMp;J tvieiuifios i^^-egulvir verbs, f)ast ten:^' 

' ' \ : ' vi C \' 

3j , ./^ ."^ '";:s i;i '.<"hs contaimiiq sonvi) with * •uiincis. Ihe 
. c.j^^i'ies r^y^iiuir -yeri^s. pjsl tense, vvilh 95'!c) accuracy. 

35 3 C,. , i.t^'cci '.vo^ds arHi hots of three vvords/dvj pupil classifies 



.vords witf^ 95 . <iCCLiracy. 



G,v.-t ,i , if \\i \% cfjntainmc] so'tuv contractions v.idi forms of to 
l:r i iMd the classifies cofU(actions with 95% 

tj . iis*!^ of .V'jrds ending in .9 the pupi! identifies simple 

<.f)ntrarlin' »s witli 95% accuracy. 
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26-8 Gi... .ov.. of pictures and orally specified word. . i possession the 

• sti;iit.i;i id-.f.tifies possessive v.'ords wilt. 95% ncci.r-:<. y. 
26-S Givv. pictures containing several different soi^ic-cis and orally 
sptc !'!=.. J directions to mark the one that does not belong, the stu- 
de.-.i cb.5sifies by category with 95?i accuracy. 
26 o- . Given rows of pictures and some orally .,,ecified category 
-ords, the student identifies countable nouns with 95% 
■-ic curacy. 

2r,-j2 Given rows of pictures and some orally specified category 
uoids, the st-jdent identifies noncouniable nouns with 
yS i'o accuracy. 



Level 3 

36-1 : Gi-.... ...uuis for the names of nine colors and rows of colors the 

st.iu- ;u itk-ntifies words for colors with 95% accuracy. 

36-2 Gi-..,i .!,o .voro: for the cardinal numbers zero through ten and lists 
01 = •. rJs. the s.'udent identifies words for cardi.nil numbers with 

'JD ,. .li...i,l,:Cy. 

36-3 (-,.. :|iu.-ci;on sentences containing ordinal nurnbe.s and rows of 
IJ.- ■ .1,., stuaent identifies words for the ordinn! luimbers for one 
tlin..,.ji. ;,.] with 95% accuracy. 

^^ '^ - ^ '-'S fo' -^lie d.iys of the week in rando..) ..,:Km IoIIow,., j i,y 

« u, j;,,,.iativo nume-als. the student puts the days of the week in 
•■ oi.tt ! ".ui. tj5% 5i. curacy. 

36-5 (3...,-, ..ords for the names of two-dimensional and three- 
diH... i.MuiKil shapes and rows of shapes, the student identifies words 
foi . s with 95% accuracy. 

36-6 Giv".: spocified words for the three states..of matter and rows of 
pic:. ,..s. ll-,e student identifie; the three states of matter with 95% 

Giva; .l,:o:,-iptive words for size properties and rows of pictures of 
obi..-...s,chu student identifies size properties with 9&^o accuracy. 

Gi.L'K M.ecified sentences, two incomplete sentences for each and 
o\ i,li.;rnative property words, the student identifies objects for 
difl.;: Mt piopertios with 95% accuracy. 

36 8.1 Given words to describe tactile properties and rows of 
pictures of objects, the student identifies tactile words 
with 95% accuracy. 
36 6.^ Given words to describe taste properties and rows of 
(iictures of objects, the student identifies taste words with 
95% accuracy. 

36 H . Given words to describe sound properties and rows of 
l.ictures, the student identifies words for sound properties 
with 95% accuracy. 



36-7 
36-8 
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Directions : Read vhat is in capital letters to the child. You aay nodify the 
words, if necessary 2 to clarify an item since this is not a standardized test. 
Record exactly what the child says in response to each item. Don't go on to the 
next iten until you have finished recording the child's answers, l^ere indicated, 
probe tlie child for nore responses to a question. Be sine to fill in all infor- 
mation and ccjplet'e all questions. For those questions where you get more than 
1 response from the child, indicate the order of the responses given by inriting 
one (1) by the first response given, tuo (2) by the secoi'd response given, and 
so on. After probing for an additional response where indicated, if the child 
isn't coming up v;ith anything, go on to the next question. 

Name Pate 



DIRECTIONS : I ATI GOIN^G TO ASK YOU SOME OlUE^IOr^S ABQUT R?i.>\miN^. THfl-m ARE m 
RIGOT OR WRONG A1\'SV?E^.S. I'D JUST ilKF: Yim ':m.T YQU T!SIK m^'ilt SS^eiNG. 
THINK ABOUT ALL THE READING YOU DG, \m JlllST mmiMl jr^f T'-O IN SGCOTt i?ffS I 
YOU THESE QUESTIONS • 

1. MIAT IS THE BEST THING ABOirr IIEAIDEJJG, TSIA^rTISJ, mm IWJ 'WJ} UKE mSV m^&t 
READING? (If the child doesni't 3ni?:vfeir, prcrrAe tby 3ayi:ng- 3tGn)etihing lii&£j., ''Cmn 
you tell me something really gooid sbonit readinrr' " Owv T^.^^omse is sufxiicfcoint.) 



2. MiAT IS THE TORST THIITG ABOUT READING, THAT IS, 1§1AT DO YOU REALLY NOT LIKIfi 
ABOUT READING? (If the child doesn't answer, iprobe by saying something litke, 
'•Can you tell me something really bad about reading?" One response Is suf- 
' ficient.) 
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j»Ai lu niHl (If the child doesn't ansi-er or gives an irrelevant 3ti«;wpt- 

5"s:.t'lcnoT"L'tr2idf "^"^-^ yo/explain ie^a^l^Ho s^::^e who 
th^t tJ. T ^ r ^ ^''"^ response (s) nay be obtained here. Bo sure 

that the ansu-ers received are relevant to the question.) 



4. DO YOU THIJSi; THAT YDU'RE A GOOD HEMTER? YES 



If yos: luLT m YOU THIMK YGffl'Pi A GOOD READER:? (Try to get 3 reasons 

why the c: r a-thirJcs he's a goo±:::re3der by probing uorth^urjhfr ouestions 



If no: B \m DO YOU THINK YOU'RE NOT A GOOD READER? (Try to get 3 reason^ 
good S^de^?') ^ '^"-"^^ '"'•^'^'^ "hink you're not a 
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5. rriEN YOU'RE READING AND YOJ CGIE TO A »'t}RD YOU DOJ^T IClOV', hHAT DO YOU DO? 

(Try to get 3 things the child does hy probing further with such questions as, 
"Is there anything else you soinstines do ^fhen you don't know a word?" For 
each ans^rer , that is, each thing the child says he does when he doesn't know 
a word, ask the question, 'WJ DOES TlUT HELP YOU?" 

A. I do 



It helps ne because 



B. I do 



It helps me because 



C. I do 



It hclr)S me because 



6. DO YOU THINK THAT YOUR TEACHER AT SCHOOL IS A GOOD RFADER? YES NO 

If yes: A. imv IIAICES HER/HIM A GOOD READER? (Try to get 3 reasons by probinf 
if necessary, with a question, such as, "Are there any other things that you 
think make her/him a good reader?'*) 



If no: B. V/HJVT flAKES YOU THINK THAT SHE/HE IS NOT A GOOD READER? (Try to 
pet 3 reasons by probing, if necessarjs with a question, such as, "Are there 
any other things that you think nake him/her not a pood reader?") 



DO YOU THINK YOUP TrACIER EVER COflES TO A ^?OIU) SHE DOESN'T KNOW VmH 
READING? 'i'ES KO - ^ 



If NO, stop. End of test. 
If YES, ask: 



mi\T DO YOU THIfJK SKE/HE CAN DO TO FIM) OUT !.W.T A irjP.D IS' fTry to g«t 3 
responses by probing vjith a qnasticn such as, "Is tliere anything else you 
think she/he can do Khan she/he corras to an unknotm voTd-"') 
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1. 
1 

2 
3 
4 

5 
6 

7 

8 

9 

10 
li 

12 
13 

14 

15 
16 



Andrew's Tftbulation ^ 

rhat is the best thing about reading » the.t is, what do you like vdst 
ibout reading? 



October Response 
You learn harder words. 



April Response 



It's fun and the only thiyig 
I have to do. 

You leam« 



You learn soaething, it's 
fun. 



Stories are fun to listen to. 
The pict^ires. 

Being (sble to reid the words. 

I think reading *s fun. You 
learn how to spell or re«id, 
then you know what it says* 

When you read you learn things 
(about) iiniaals, people, 
countries, states. 

Like reading at school. 

It*s okay... can *t say 



Pictures. 

You can read about dogs> 
cats; horses, goats, turtles, 
pigs, and birds. 

Learning how to> read. It's fun. 



Well.*. nothing. You like to 
sound then out . 3 ^ 



Riddles, 
Little words, short stories. 



It's fun when you don't have 
anything to do. 

You learn something; when you 
grow . up ^ you have to read signs 
and everything so it's a good 
thing to learn to read. 

The stories we can read. 

That they have easy words and 
they're fun worHs. 

You learn about something or how 
to nake something, 

Good stories; getting up into 
higher books, I llk^ my old 
(reading) teacher better Mrs. X. 

When we go in the booth to read 
stories. v 

I like reading because I want to read to 
iry Mosi & Dad, I like it because it d.s 
fun for me • 

Better for you. Learn how to 
read and you knw how to do 
alot of stuff . 

You learn stuff . 

It's no ftm. I don't like to 
read. ^ 



Reading itself is not fun but 
the stories are fun. 

The story. 

Pictures . I like to look at them ^ 
but that doesn't mean I like to 
read (about) them. 



wtooer Kcaponac 



Child 17 

18 
19 

22 



It*s fun and it gives you 
something to do. 



The de«r book (short). 



Nothing. I don't like to 
read. 



April Response 



Sonetiaes if you don't have 
nothing to do you can find a 
book to read. 

Nothing. 



Nothing. 
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2. 

1 
2 
S 
4 

5 
6 
7 

8 
9 

10 
11 
12 
13 

14 

15 
16 

17 
18 



Ifhat is the worst thing about reading/ that is, what do you really not 
like about reading. 



October Response 

When I stuBble over words. 

I/)ng stories. 

Sone words are hard. 

So»e words and letters are 
hard. 



When I don't know how to 
read. 

The words. 



-Stories aren't too fun~too 
long. Rather not read out 
loud, it takes too long. 

Reading a whole book; read- 
ing too aany pages .at once. 



When you haye to quit reading 
and you're at the best part 
t>f the book. 

Tearsheeta (Worksheets).. 

Somebody goes too f ast • 

Have to sptxnd , out the words . 

You can't get to do anything 
you want when you have to do. 

Reading books of certain types. 



You don't like to read. It 
ain't no fun when you don't 
know how to read. 

If somebody bothers ae I 
aight not want to read. 

Stay, up on reading chairs 

too long. 39-^ 



April Response 

Hard words. / 

Everything. / 

,/ 

Them hard words. / 

There might be a long/page and I 
don't like to read ri^al» real 
long pages. 

Trying to spell words. 

That they are really really 
hard words. 

Reading in the booth (orally). 



Trying to figure out hard words, 
I don't like people being so slow. 
I hardly ever get any free reading 
time. 

Nothing~I like it all. 



Well, I don't know some words, 
(Wouldn't answer) . 

I don't like to look-up the words. 

No good stories. 

Reading pages and questions. 

You have to read it. 

You have to sound out word. 



It's not that fun unless there's 
a good story. 

Cause I get a headache every time 
I read. It's really hard for me 
read. 



Child 19 



Octcber Respcnsa 



April Response 



22 I don't know. 
I h«te it. 

I like to go out and play. 



Everything. 
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If you went to talk to the kindergarten pupils about reading, what would 
you say to thea. 



October Response 



Reading is hard. 



Ask theai if they like to read 
and like to look at pictures. 

Soae words are hard. / 



Spell out words / sound them out» 
you*d have a good time reading. 



Look, we read it to/ then » then 
they look at the pages and 
read with ne. 



There's lots of things to learn 
about reading. You gotta listen 
to the teacher. 

Show them how to sound out words. 
Read thea a book. 

Reading is fun. The rore you 
know about reading » the more 
you know. 



Reading is the best way to learn 
about math/^ language and people. 

I don't like reading. 

I couldn't say. 



Pictures are good to look at. 
Don't look at pictures while 
reading. 

Would you like to read? 
Wouldn't you like to read? " 



Nothing/ I don't know. 
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April Response 



That readin' is not fun. 
hard words in readin'. 



There's 



Northing to it •' It's simple. 

word is "the/* number 1 that 
K^:ls nuuber 10, that's; all I can 
■ / 4l them. 

iSecsad the word out first, then read it. ^ 
IS light start getting harder so practice 

^^w. ^ . . ' \ 

Ask theffi if they knew how to read. 
If they said yes, I'd tell them to read 
alot. If they said no, I'd ask them to ; 
try iind read. 

It 's easy to read if you know your. 
A.B.C's. You have to sotmd out some- 
times if you don^t know the word. 

Reading is easy, sound it out, the 
teacher helpa. 

Reading is a little hard but it's fun. 
You have to 'figure out words. Every 
word has a little wtd in it and you 
cover-up certain letters to find out 
the word. 

^ . . . ■ 

I can't thin^c of anything to tell 
them. ' ' , 

What do you like about ' reading? You can 
learn from 2nd grade through all the 
grades. You ahouXd learn reading. 
Listen to the teacher and learn now 
to do it. Let thai try to sound out 
words and read the sentence. 

Make sttre they learned their phcmlca. 



Give them a book with pictiires no 
words. 

It's fun and not fun, easy and hard. 
I bet you'd like It.o 



Child 15 
16 

17 
18 
19 



22 



October Response 



When you don't know a word, 

sound it out. When you have 

a book you sit down § read it. 

Reading is fun it's very easy 
to do. 

Noticing 



I don't like it; a bunch of 
words in a sentence. ..Why should 
they be in a sentence. 



April Response 



Pronounce it out. 

I hate it. It's just dull. 



Sound out words if they don't know 
them. 

Just to read, and do your work very 
g^od and the teacher will like you. 



That you read out of a book. Just 
look at the words and sowd them out! 
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1 

2 
3 
4 
5 
6 
7 
8 
9 

,10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
22 



3 you think you're a good reader? 



/ 



October Response 



April Response 



yes 

no 

no 

yes 

no 

no (not very well) 
yes 

yes (a little) 
not really 
yes 

no 

yes 

yes 

yes 



no 



yes 
yes 



yes 
no 
no 
no 

yes (a little) 

yes 

yes 

no T then yes 
yes/no - fairly 

yes 

no 

about even 

no 
no 
no 
yes 

yes 5 no (a little) 



no 



9 yes 1 both ; ^0 4r 



yes/no - half 

4 yes\ J 6 both ^ 9 ^>-<? 
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1 

2 
3 
4 

5 

6 
7 
8 

9 

10 
11 

12 

13 
14 

15 
16 



If yes: Why do you think you're a good reader? 
If no: Why do you think you're not a good reader? 



¥^---1 ;smi mad good, 

&T -Bfe8caxa5© Vm here. 

K't -ii^'t tafidtw many words. 

¥«£S-ViVhen ?raaut cone to a big word 
tfvfHt'you d«m't know, you sound 
it^ W& and tkmn read it and 
youf^pe rigifet. 

N0--I don 'x know words, long words ^ 
hard words big words , words with 
too many Darters. 

No--BecausQ I miss alot of words. 

Yes— I can 5SOu:>d out words I can 
read pretty fast. 

Yes--I'm learning how to sound out 
words. Good enoughs 



No--Not really: Because I don't 
know alot of words, also I don't 
read that many different kinds 
of books. 

Yes — I read loud. 

No- -There are alot of reasons. 



Yes— Sort of (no other responses). 

Yes --No reasons. 

Yes-- I know most of the words. 



N0--I don't teaow as much as you. 
I haven't bmen in as many grades 
as you. 
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Yes — £«c»use thcf^y's easy i^rords. 

No--Bocause I doii'^ like it. 

No-- (Wouldn't Bi^LW reasons). 

No--Miss too mro^ words on spellinirT 
tests, miss Imn asnd nhort vowels- 
nothing else. 



Yes-- 1 like st<ml^^^ msxd story books 
I like to fin^ ajttt fiv^ngs I don't 
know. 

Yes--Becaaftf I ire^ja^^jsod sonetlMS. 
Sometimes : ii^Ss^mf words righr. 

Yc^s-- 'Cause rr'ia in aLi:nigh reading 
book. I can hmissTd words alot. 

Yes/No--r don.'^ teow I figure out 
some words I jxihm'c:: feow. treading ^ 
words right <of!f mfcEthout having to 
figure them <ou)t. 

Yas/?6iH^-3 ^fin n5>iwL 3omo books but 
I cr; t j^ad'hci^ witli real ski,nny 
lines in it. 

Yes — Because I like to read to my 
Mom 4 Dad. Becaxiae I'm having a 
reading ponteat. 

N0--I 'm behind everyone; I'm in a 
lower book; I like to try but I 
fail alot. 

Even Yes/No- -I can't read good but 
1/can read better than bad. 

N0--I don't like to read. 

No— Everyone got but I did/not. 
Don't figure. 

No— r don't know why. 

No— They know whan tto stop 5 when to 
^go, the periods § oonwa. They know 
words better. 



October Response 



April Response 



17 1 Yes --Cause it don't take me 
long to read cause I know lots 

I of words. I'm real quick. 

18 I Yes Re ad some words but don't like 
to learn. 



19 



22 |Yes/No--I can sound the words out 
I sometimes , I *m slow, it takes time. 



Yes--C53a!se I use to mot read too much 
and didm't read very igood. Now I do 
and I oan read fester^ 

Yes /No-- A little- Nt?Jrhing. Maybe I 
don't want to. 



Yes/No~-Half I J it^-^: that g^d but 
I'm okay— I lan.?V ^t^^^ an/tihi'i?^f else* 



EKLC 
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5, When you»ro reading and ^ou-come to :^fl kncDW, what dc you 

do/How does that help ymi? (3 reasons if ipBssible;) 



Child 1 



October Response 



Ask the teadier: She'll tell me 
Use my phonics: It helps to 
sound it out; ask ,i neighbor 
they'll tell me, 

I sound it out: if you r 
sound out a word you cjSi^' 
know- -you won't get it 

I sorumd it out: it's et^^^^T to 
get thie word. I think: I get 
the answer faster. 

I sound it out: I learn more 
about the word. I look at it ^ 
I spell it to myself. I ask 
one of my friends : they 
might know it. 



I don't read them: ■ 
I tell the teacher: She hej,ps 
me with the word. I try tSA 
sound it out: hear all the 
letters . 

I sound it out: then you will 
know the word. I ask th© 
teacher she tells me the word. 



I sound it out: because I 
can put words together, I 
skip over it: I can go on 5 
read^t ho whole sentence 6 
things back & figure it out. 

I sound it out: cj)ecause I 
can hear it better. I find 
the base word: I can add on 
to it. 
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At^I Response 



T ast tte ^^achor: t^^t^es me \tca^Js. 
5 try t<P p^^ocmce .it it helps l!«am 

th^^ t^h&$rz:.: ?:^^timwfe f^e tell^ me. 



"i .arx..- the teaci!rf.:;r: I :doTr/'t teofe (how that 



I pitfi!5!s:3unt:e the word:: when I lyigK^inouiiace it, 
it tefena ime put the *tford togdch^jr:. When I 
sets ^ wo^rtik together if ou know to say the 
list ♦.i^rd. I stare at: it: I start seeing 
one itea^d, tthen ;aaothttr and then you can put 
th© Z2 togs^ther. 



vm^ the Sismtsnce: 



Faouml it :^out;: 1/ 111 get the word. I 
asik the teacher if it's hard, sheUl telL 
me to soundi-it out and if I still don't 
know she 'IL tell me. 

I say blank: I can read the whole thing omd 
I might know what it is. 

I sound it out: it helps me get it. 
I ask the teacher: 



I cover certain letters to see if there's 
smaller >rd's in the word: Most words have 
little Words in them. I sound it oftit: I 
learn to say them better. I say bHuik ft read 
the rest odf the words: you don't taa^ the word* 
right away^ and you see if it makes r«nse- 
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April Response 



10 



11 



12 



13 



14 



15 



16 



17 



18 



19 



22 
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I ask sam^p^ to "help me find 
out *<h^i| th mtri' is: I re- 
mcnibfv^ ^*vKwdi:Ticft o r s omeon e 
telJbs i smsxud it out: I 

learn ttfft^ m^q^i a remember it 
in raf--^i^!^£smiM3E^-^ 



I ask the teacfe';r: 
it down^ 



she writes 



Try to figure it 
Ask the teacher, 
remember. 



out: 

it helps mo 



I skip if it's long I 
skip it.. Lmm\i it out ! it 
helps my mifegB 5 understanditrf 
the stoTT* 

I ask the teacher: because you 
can read after^ you oread or know 
the word. I ask Msrnn: she tells 
me the right word. 

I ask thw teacher: don't know 
I skip it: don't 3tmow. 



I sound it out : . I 

skip it (no help) I ask someone 
what it is (no help). 

I usually ask somebody: I don't 
know the word ft I can go on read- 
ing if I know the word. I sound 
it out: I might knw it. I 
think about other words 5 try 
the "e" sound so I know if it's 
a lang vowel sound. 

I ask the teacher: * 

I ask one of the ki^sl . 



I stop & think about it. I sound 
it out: itecause 1 can sound out 
each lettter. 
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1 skip it: it idioesn't help. I pronounce 

it: I miifM cssone to it again S then I'd 

know it. 3 niafc the teacher: she breaks 
it up for ^ne.. 



I ask someone — ^They teLL roe. 

I figure tbe word out — I aound it out. 

helps me kmow. the word. 

I don't know. 



It 



I skip it U try to figure it out by words 
in the sentence: otherwise I'd wear myself 
out on one word. I sound it out: it helps 
me remember the wotd. 

I say blank and read the rest of the sentence 



I ask the teiacher: you can move on I ask 
my mother, farther, brother: you can move 
on. I skiTp iLt: it doesn't help. 



I skip it:: I can go back to it. I ask the . 
teacher: 1 get to know it. 

I pronounce it out, I don't know why. I 
ask the teatiher. 

I don't do anything. Ask the teacher. It 
helps because she puts it on the board and 
we stare at It. 

I sound it out: if you know all the letters 
you can put them together you can know them. 
I ask somebody to help me. I sound it out 
more. 



I ask the teacher: 

I sound it out: 

I skip it; 



I sound it out; helps because I can sound.it 
out better than just saying it. I try to 
read it: I don't know how it helps* I 
don't do nothin'— maybe read on § go back. i 
It helps because I might figure it out. 



Section 18. 



Sample Letters Sent to School Administrators, Teachers 
and Parents Concerning the Tutoring Program 
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CITH 

Center for Innovation in Teaching the Handicapped 

Gchool of Education, Indiana University ^ 
2805 East Tenth Street. Bloomlngton, Indiana 47401 
•Phone 812/337-5847 

September 11, 1975 



The Teacher Education Laboratory of CITH, will offer a program of 
tutoring for reading iniprovement • It will begin mid October and continue 
till the close of the winter semester (end of April). 

We would like to enlist your cooperation in making the availability 
of the after-scliool tutorial program known to the teachers in your school 
Children eligible for the program are those in grades 2 and 3 who are one 
,or more grade levels behind in reading, and children in the upper 
elementary grades who are 2 or more gra-^^e levels behind in reading. We 
can accept both special class and rpgul or plars pupils. 
' ■' ^ . . .. ' V ' 

Ihe tutors assigned to work on a one-to-*one basis with pupils are 
juniors majoring in special education. : lKcy are participating in a 
program for training teacliers in reading improvemtent. 

The program has been carefully designed tb include training in aTl 
aspects of teadilng readipg. . The trainees will be closely supervised 
and accountable for individual; p^>il .p^rbgrain.planning, pupil attitude 
and periodic assessment. Trainees,^ are^ required. to demonstrate mastery 
in diagnosis, lesson planningV prescription, and oral reading skills 
prior to working with pupil's; F.xpert cohsultaticn and reading materials 
and resources will be avail'able to the tutors. 

Tlie project will also serve as a means., for conducting studies on 
the teacliing-leaming process, and the parents of participating children 
will be informed of this. 

We would appreciate your informing the teachers in your school of 
.the availability of the tutorial program by circulating the enclosed 
referral sheet. If it is convenient^ we will collect the referrals 
from your office on September 19, 1975. 

> 

. Children in the program will receive two hours of tutoring per 
week, with tutorial sessions scheduled between 3:30 and 5:30 p.m., at 
the Laboratory Classroom at CITII. Initially, we will be able to provide 
tutorial service for up to 22 pupils. 
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If you have any questions about the service, I will be pleased to 
answer them, so feel free to call me. 

Sincerely yours, 

Dorothy Semmel 
Research Associate 

Enc. 

US/lp 



r 



\m1 *^r<" 

CITH 

Center for innovation in Teaching the Handicapped 

School of Education. Indiana University 

2805 East Tenth Street. Bloomington, Indiana 47401 

Phone 812/337-5847 

September 11, 1975 



To MCCSC Teacliers: 

The Teacher Education Laboratory of CITH, will offer an after-sdiool 
tutoring program for reading improvement. 

Children eligible : Second and 3rd grade pupils who are one year 
behind in readings and upper elementary pupils who are 2 or more grade 
levels behind in reading. Botli regular class and special education 
pupils can be accepted. 

Time: Two one -hour sessions per week, to be scheduled afternoons 
between 3:30 and 5:30. The program will begin October 13, 1975. 

Place: The Teacher Education Laboratory, Room 150, Smith Research 
Center (Old L^iversity High School) 2805 East 10th Street. 

gtaff : Tutors are I.U. education students who are being trained in 
Reading Instruction. They will be carefully and continuously supervised 
and will have both consultant assistance and extensive reading resource 
materials available. 

' • 

' Program : Emphasis is on pupil development of oral reading skills 
and comprehension. Other remedial goals will be established, based on 
individual pupil needs. ~ - 

Research 'on the teaching-lemming process will also be conducted in 
connection with the tutorial program, and parents of participating chil- 
dren will be informed of this. ^ 

Cost and Transportations : There is no cost for the tutoring service 
but parents will be expected to make own transportation arrangements 
whenever possible. (Some transportation assistance may be available 
from time to time.) 

Referral : If you have a pupil in your class that you think will . 
benefit from supplementary tutoring in reading, please write his/her 
name, home address and phone number on the next page. 
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We will write to eadi parent directly and ask them if they wish to 
enroll their diild in the program. The letter to the parents ivill 
en^jhasize the voluntary nature of participation in the program, as we 
would avoid the inpli cation that you expect or require it. 

If you would like further information, call Dorothy Semrael. 337-5847 
(336-8952, evenings). 

Names of pupils who would benefit from an after-school tutoring 
program in reading. 



Home Address Phone No. 

1. 

• '1 

2. 



3. 



4. 



5. 



Teachers name _^ 

Grade - 

— ' ' 

School 

Please return to principals office before September 26, 1975^ 
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The Teacher Education Laboratory 

School of Education. Indiana University 

2805 East Tenth Street. Bloomington, Indiana 47401 

Phone 812/337-5847 



Scptcmlicr 23, 1975 



Dear Parent: 

V/e arc KritinjT to tell you about the availability of a free-after 
school tutoring! jirogrrun for reading improvement. 

The ])roj;r ani will emphasize improvement of oral reading and reading 
for undcrstandinn. Other remedial goals ivill be establislicd based upon 
individual pu])il needs. 

Tutors are I. II. education students v;]io are being trained in Reading ' 
Instruction. Thov will be carefully and continuously sujjervised. Reading 
materials mid reading consultants will be available to Iielp the tutors 
plan an individualized program. 

Giildrcn elijirble for the program are elementary school pupils, 
second grade or older, wlio are liaving problems with reading- 

Cost and t ra]isportati_on: lliere is no cost for tutoring l)ut parents 
are exi)ected to j^rovide trans])ortation. Some helj) with transportation . 
may be available from time to time. 

riacc: Tutoring will tahe place in tlie Teacher Hdiication Lab'orator)', 
r.oom 150, Snitb Research Center (Old University Iligli Sdiool) 2805 East 
Tenth Street. 

Time: Ibcrc will he two, one' hour tutoring .ser^sions per week , to be 
scheduled ^afternoons between 3:30 and 5:30 p.m. • . 

Lnrollment : because the number of children we can accei)t into tlie 
program is limited, it is possible that v:e will not be able to take everyone, 
wlio apj)lies. 



If you are interested in obtaining tutoring for your child, I will be 
hap])y to talk with you md answer any questions you have. Please call me 
at 537-584 7 for furtlier information. 



Sincerely vours , 




V 
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Dorotliy Semmel 



DS/lp 
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CITH 




CenJer for Innoyafion in Teacbmg the Handicapped 
School of Education. Indiana University 
2805 East Tenth Street. Bloorrtiogton. Indiana 47401 
Phone 812/337-5847 » . u a ^/^ui 



September 12, 11)75 
\ 



Dr. Ronald Walton 

Su]oerintendent of Sdiools 
MCCSC > 
North Drive 

Bloomington, Indiana 47401 
Dear Dr. Walton: 



Cmi "win'offo.'f ^''"'^ "'"^^^^ Education Laboratory of ' 

kno,vnVaC^;e1:„:L\^rsch1o^ after-school tutorial pro«ra. 

nearest to the Smith S Sch ^entJr n^ '"^"'x ^""^'^'^ 

I am enclosing a co y of ?hri^rJ! «I'ich our Teaching Lab is located, 

the program i,' greafL d.Jax^ """V '° ''''^ principals, which describes 

training scttinc for our ^^-nrion-c ^3^^^"' establishing a meaningful 

"iti, the tutoring nrorrMi win con, iv'„,>i *T f connection 
uiations concon,L', pjo^et^on TZl't.t\,nVf..T'r^°;^' " ^ 

I Kill be hnp,,y to answer any questions you lUvo about the program. 

Sincerely yours. 



Melvyn I. Semmel 
Director 6 Professor 

L'nc. 
MIS/lp 
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CITH - 

Center for Innovation in Teaching the Handicapped 
School of Education, Indiana University 
2805 East Tenth Street. Bloomington, Indiana 47401 
Phone 812/337-5847 

September 17, 1975 



Dr. D- Ebeling 

Director of Elementary Education 
MCCSC 

North Drive 

Bloomington, Indiana 47401 
Dear Dr. Ebeling: 

We wish to inform you that the Teacher Education Laboratory of - . 
CITH, will offer a program of tutoring for reading improvement, beginning 
mid October and continuing to the end of the school year. 

We plan to make the availability of the after-school tutorial program 
known to about 6 elementary school principals whose schools are located 
nearest to the Smith Research Center in which our Teaching Lab is located. 
I ajn enclosing a copy of the letter-sent to the principals, which describes 
the program in greater detail. 

As sponsors of the program, we are cognizant of the responsibility 
to the children we plan to serve, and have taken care .to see that the 
program meets the highest-professional standards. By providing the 
tutorial service and requiring the tutors to be accountable for the 
pupils' reading improvement, we are attempting to meet several imp^ortant 
goals; providing a useful community service, establishing a meaningful 
training setting for our students, and conducting research into the 
teaching- learning process: Naturally, research conducted in connection 
with th^' tutoring program will comply "with all federal and local reg- 
ulations concerning protection of human subjects in research. 

I will be happy to answer any questions you have about the program. 

Sincerely yours, 

' i * 

Dorothy Scmmel 
Researcli Associate 

Enc. ' 

DS/lp%. 
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CITH 



Center for Innovation in Teaching the Handicapped 
School of Education, Indiana University 
2805 East Tenth Street. Bloomington, Indiana 47401 
Phone 812/337-5847 



September 17, 197S 



Dr. N. Rogers 
Reading Coordinator 
MCCSC 

North Drive 

Bloomington, Indiana 47401 
Dear Dr. Rogers: 

CITH ^wn J'l;^? ^^^^^^^ Education Laboratory of 

TiriLT Research Center in which our Teaching Lab is located 

to thf ch?rar.:^pra: ^1:^^:1^^:^-^^^ ^^\}^ 

progran, n>ects_the highest professional standards. By providing the 

mTll' rllZ"'-"' ^'^"'^'"^ ^° accoLLbl for III 

2oals .^ovfn^n ^"^^"^^Z^"^'.^- are attempting to meet several important 
goals, providing a useful community service, establishing a nieani^eful 

tea'cSlnf L^^;"' conducting -research into Jf "' 

•with JJf tutj; .':'f^"^^lly> research conducted in connection. 

l\Tt^l^l tutoring. program will comply with all federal ai.d local reg- 
.ulations concerning protection of human subjects in research. . 

I will be happy to answer any questions you have about the program. 

Sincerely yours, 

Dorothy Semmel 
Research Associate 

Enc. 

(■ 

DS/lp 
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CITH 



Cantfrr for Innovation in Teaching the Hsn^capped 

SctKX)! of Education, Indiana University 

2S05 East Tenth Street. Bloomington. Indiana '47401 

Phone 812/337-5847 



October 8, 1975 



I hereby give permission to the leacher Education 
Laboratory of CITH, Indiana University, -to observe and 
video/audio record tutoring sessions in which my child 

participates, and permission to use these 
records in teacher education research and for development 
of teacher training materials without limitation. 

Date Signature _^ 



Name 

(please printj 



Address 



\ 



> 



•/ 




/ 
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Tm Teacher Education Laboratory 

School of Educaiion, Indiana University 

2805 East Tenth Street. Eloomington, Indiana 47401 

Phone 812/337-5847 



October 8, 1975 



Dear 

We are pleased to accept your child into the Tutorial Reading 
Program. 

is scheduled for tutoring every at 
at the Smith Research Center, 2805 East 10th Street, Teacher Educ 
ation Laboratory Classroom, Room 150. The first session will be 
held on , , October 

Since the tutorial service is offered in connection with a 
prpgram of research on the iinprovenvent of teaching, we will be 
observing and recording the teaching that takes place. Would you 
therefore, sign the enclosed permission form and bring it along 
on the first day. if you have any question about this or any 
other aspect of the program, please call me. 



Sincerely yours. 



Dorothy Semmel 
Research Associate 



Enc. 
DS/lp 
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CITH 

Center for Innovation \tt Teaching the Handicapped 

School of Education. Indiana University 

2805 East Tenth Street, Bloomington, Indiana 47401 

Phone 812/337-5847 



February 3, 1976 



Dear Parents: 

As you know, your son or daughter is being tutored in both oral 
reading and any specific word attack skills he or she may need. 
Our tutors are undergraduate students in education currently being 
trained in various aspects of teaching, one of which is reading. 
As part of their training the tutors are participating in the 
Computer Assisted Teacher Training Service (CATTS) . Through this 
service, they are observed while teaching, their beha.ior coded 
into the computer and finally are provided with specific infor- 
mation about their teaching and ways to improve it. 

Our goal is to provide your child with a better reading teacher 
so as to improve his/her reading. If you have any questions, 
concerning either the program or your child, please contact us at 
537-5847* You're welcome to visit us anytimel Thank you for 
your participation. 

- Sincerely, 
Darla Cohen 

DAC/jah 



4X3 
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DAILY HERALD-TELEPHONE. BLOOMINGTON, INDIANA 



Movie times 

PRINCESS 
^ *-Sq)cr. Vixens.*' 2:00. 3:50, 
5:35.7:20,9:20. 

INDIANA 
^Vihor 1:45. 3:42. 3:34, 7:26. 
.9:a 

VniAGE 

"Monty Pythcm and the Holy 
• Grail," 7:00. 9: 15. 

TGWNECINE3IA 
"Jaws," 7:00, 9:30. 

CINEBIA2 - 
••OlhecSide cf the Mountain,*' 
1:30.3:25,5-3.7:30,9:15. 
CINEMAn 
"King of Hearts," 1:15,3:15, 
5:15,7:20.9:20. 

VON LEE 
; "And Now My Love," 7:04. 
J 9:13. 

; WESTCINEB4A 

j "Country Hooker.*' 7:35; 

' "Around th§ World," 8:50; 

"ToadJ Me.'* 10:00. ' 
1 STARUTE 
I "The McCulIochs/* 7:30. 

10:40; "Macon County," 9:05. 




I nUMa MTEANATlONAi 



$«i and Violinct Cm 
U l)iR9tf om to Youf Hflilth. 




j0»ATUin>Ar4SUN0AY 



I 



Opmn 1t30 WML $ot. 4 Sun. 

' riNALWEEK 



tutoroT^ 



reading 
started 

A select groisp of eJenientary 
school children viho are behind 
in reading be accepted for 
an after-school tutoring 
program for reading improve- 
ment with no charge for the 
service. 

Second and third grade pupils 
who arc one ,vear behind in 
reading, and upper elementary 
pupils uIjo are tw^) or more 
grade le%'els behind will be 
eligible to participate in the 
special program. 

The tutorial program is being 
arranged by the Center ^for 
Innovation in Teaching the 
Handicapped. The center is 
part of the School of Education 
at Indiana University. Parents 
interested in enrolling their 
children in the tutorial program 
may phone research associate 
Dorothy Semmei. 337-5847 
during the day or 336-8952 even* 
ings. 

EPoth regular and speda] 
education pupils can t>e sic- 
cepted for the program, which 
will involve two one-hour 
sessions each ^eek between 
3:30 and 5:30 p.m. The sessions 
will be at the Teacher Educa^ 
tion Laboratory. Room 130, 
Smith Research Center (Old 
University High School), 2805 
E. lOlhSt. 

Tutors will be iU education 
students, who are being trained 
in reading instruction. Em- 
phasis will be on pupil develop- 
ment of oral reading skills and 
comprehension. Other remedial 
goals will be established, based 
on individual pupil needs. 

Parents will be expected to 
provide transportation for their 
children, although limited 
assistance may be available 
from time to time. 



SATURDAY. SEPTE 



Weather Vane 



30pO matiOmai wfATKf t SflvfCf FOefCAST 7 fa ISI ^-aT* 73 

r ^ 

<ooo- 

SAM f KAKClSCO 




WfAlHflfOIOCAST 

Saturday will ffind a few showers 
lingering over parts of the north 
AtlaotSc states. Show^ activft^^r 
is also lodircated for loi^ 
Florida and tliie nortteem Ftatns, 
atfherwlse, generailly fair 
weather s^hould prevrail 
elsewhere. Maxintrura feem- 
peratmres include: Atlantai0, 



Boston 70, CSiicago C Oa] 
Denver 71, Dulatta «4. H 
72. Jacksonville 72!^ Kansi 
76. Los Angeles TUt^JMlM 
New Orleans 78, Wcw y< 
Phoenix 97, San Franefi 
Seattle €6, St. Looia 0 
WashingtonTtB, ^.z 



High-Lows 



' By Unttttf Prtu 

cm 

AUouquefQw c 
Arnchoraoe r 

Birminghjm pc 
Bosloft r 

Ch»»lrt»oo 5 C PC 
Ch«rloMe NX. pc 
Cheyenne c 
Chicago cy 
CteveJand r 
Cotumbui f 
0«Tiat c 
Denver c ^ 
On Atoines c 
Detroit cy 
£1 Pmo c 
Hartford r 
Honotulu e 
Houston c 
infliioapoiis cy 
Jackson Mitt, c 
Jackionvirie c 
Kansat City c 
Lat Vegas c 
tmie Rock c 
Los AnoeH 



imwrnatfonal 
Ml to Pep 

76 IS . .. 

53 i8 
72 50 

61 54 

47 U 

60 SS 

ai 48 
7S $7 
69 40 
$8 54 

54 57 
S» $S 

77 $1 
74 39 
65 40 

45 SI 
81 47. , 
$9 54 7.38 
18 76 . 
79 57 . . 
47 49 
74 44 
13 65 
43 79 
95 64 
77 



:5rtM U^ft City c 
.'Saa Die^; c 
^3an^ Prancitsco c 
^ao Joan ipc 
3eair.e pr 
Spokane c 
"Tampa pc 
'W^&hingfon r 
Wtchtfa c 



07 



20 



Zx)ne Fo« 

H 69.... loMtW 

t9 57 .... AAostly ctoudf 9Vfm • < 

t; 76 t n^tf9in)o6f$f:Mgh 
46 56 .... the upper J0« fo around 
77 51 .... fon»gfitmid4Qs.rrId«vcll 
17 72 .02 continued cool. H)g«it In fl 
71 64 1.20 . PTKipttaNon preb^MlNIc 
64 42..^ ctntlodtfVdndTOlonlfllit.: 



Moslty cloudy witli cftM 
rain loday. HlfiM mpm 
•round 49. Mostly clou^ I 
cooler tonight. L0wt IT; m 
Friday clearing and cwiNi 
.Highs in the low ^ 
preM(mi«:)0p«rcMl9l 

- — - 'X > 

lontsM^M 




